INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:14:28,615 - lava_callback - INFO - Received callback for node 69e1ebd8408ad4de24863bed 2026-04-19 08:14:28,622 - lava_callback - INFO - Starting async job submit for node 69e1ebd8408ad4de24863bed INFO: 172.21.0.1:34642 - "POST /node/69e1ebd8408ad4de24863bed HTTP/1.0" 202 Accepted 2026-04-19 08:14:28,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:14:28,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ebd8408ad4de24863bed HTTP/1.1" 200 None 2026-04-19 08:14:28,664 - lava_callback - DEBUG - Processing node 69e1ebd8408ad4de24863bed: baseline-arm64-clabbe 2026-04-19 08:14:28,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1ebd8408ad4de24863bed 2026-04-19 08:14:28,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:14:28,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ebd8408ad4de24863bed HTTP/1.1" 200 None 2026-04-19 08:14:28,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:14:28,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-19 08:14:28,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:14:28,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1ebd8408ad4de24863bed HTTP/1.1" 200 None 2026-04-19 08:14:28,738 - lava_callback - ERROR - Error processing callback for node 69e1ebd8408ad4de24863bed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39732 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:15:48,717 - lava_callback - INFO - Received callback for node 69e1ec27408ad4de24863c12 INFO: 172.21.0.1:39736 - "POST /node/69e1ec27408ad4de24863c12 HTTP/1.0" 202 Accepted 2026-04-19 08:15:48,725 - lava_callback - INFO - Starting async job submit for node 69e1ec27408ad4de24863c12 2026-04-19 08:15:48,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:15:48,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec27408ad4de24863c12 HTTP/1.1" 200 None 2026-04-19 08:15:48,810 - lava_callback - DEBUG - Processing node 69e1ec27408ad4de24863c12: baseline-arm64-clabbe 2026-04-19 08:15:48,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1ec27408ad4de24863c12 2026-04-19 08:15:48,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:15:48,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec27408ad4de24863c12 HTTP/1.1" 200 None 2026-04-19 08:15:48,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:15:48,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-19 08:15:48,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:15:48,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1ec27408ad4de24863c12 HTTP/1.1" 200 None 2026-04-19 08:15:48,977 - lava_callback - ERROR - Error processing callback for node 69e1ec27408ad4de24863c12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:17:08,688 - lava_callback - INFO - Received callback for node 69e1ec77408ad4de24863c65 INFO: 172.21.0.1:59144 - "POST /node/69e1ec77408ad4de24863c65 HTTP/1.0" 202 Accepted 2026-04-19 08:17:08,697 - lava_callback - INFO - Starting async job submit for node 69e1ec77408ad4de24863c65 2026-04-19 08:17:08,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:17:08,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec77408ad4de24863c65 HTTP/1.1" 200 None 2026-04-19 08:17:08,724 - lava_callback - DEBUG - Processing node 69e1ec77408ad4de24863c65: baseline-arm64-clabbe 2026-04-19 08:17:08,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1ec77408ad4de24863c65 2026-04-19 08:17:08,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:17:08,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec77408ad4de24863c65 HTTP/1.1" 200 None 2026-04-19 08:17:08,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:17:08,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-19 08:17:08,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:17:08,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1ec77408ad4de24863c65 HTTP/1.1" 200 None 2026-04-19 08:17:08,812 - lava_callback - ERROR - Error processing callback for node 69e1ec77408ad4de24863c65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:18:28,775 - lava_callback - INFO - Received callback for node 69e1ecc9408ad4de24863c9a INFO: 172.21.0.1:38086 - "POST /node/69e1ecc9408ad4de24863c9a HTTP/1.0" 202 Accepted 2026-04-19 08:18:28,784 - lava_callback - INFO - Starting async job submit for node 69e1ecc9408ad4de24863c9a 2026-04-19 08:18:28,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:18:28,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ecc9408ad4de24863c9a HTTP/1.1" 200 None 2026-04-19 08:18:28,832 - lava_callback - DEBUG - Processing node 69e1ecc9408ad4de24863c9a: baseline-arm64-clabbe 2026-04-19 08:18:28,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1ecc9408ad4de24863c9a 2026-04-19 08:18:28,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:18:28,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ecc9408ad4de24863c9a HTTP/1.1" 200 None 2026-04-19 08:18:28,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:18:28,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 08:18:28,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:18:28,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1ecc9408ad4de24863c9a HTTP/1.1" 200 None 2026-04-19 08:18:28,965 - lava_callback - ERROR - Error processing callback for node 69e1ecc9408ad4de24863c9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:19:48,837 - lava_callback - INFO - Received callback for node 69e1ed18408ad4de24863cbc INFO: 172.21.0.1:40368 - "POST /node/69e1ed18408ad4de24863cbc HTTP/1.0" 202 Accepted 2026-04-19 08:19:48,843 - lava_callback - INFO - Starting async job submit for node 69e1ed18408ad4de24863cbc 2026-04-19 08:19:48,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:19:48,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ed18408ad4de24863cbc HTTP/1.1" 200 None 2026-04-19 08:19:48,884 - lava_callback - DEBUG - Processing node 69e1ed18408ad4de24863cbc: baseline-arm64-clabbe 2026-04-19 08:19:48,884 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1ed18408ad4de24863cbc 2026-04-19 08:19:48,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:19:48,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ed18408ad4de24863cbc HTTP/1.1" 200 None 2026-04-19 08:19:48,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:19:48,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-19 08:19:48,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:19:49,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1ed18408ad4de24863cbc HTTP/1.1" 200 None 2026-04-19 08:19:49,038 - lava_callback - ERROR - Error processing callback for node 69e1ed18408ad4de24863cbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45710 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:29:29,280 - lava_callback - INFO - Received callback for node 69e1ef5d408ad4de248642ab INFO: 172.21.0.1:45722 - "POST /node/69e1ef5d408ad4de248642ab HTTP/1.0" 202 Accepted 2026-04-19 08:29:29,286 - lava_callback - INFO - Starting async job submit for node 69e1ef5d408ad4de248642ab 2026-04-19 08:29:29,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:29,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ef5d408ad4de248642ab HTTP/1.1" 200 None 2026-04-19 08:29:29,303 - lava_callback - DEBUG - Processing node 69e1ef5d408ad4de248642ab: baseline-arm64-clabbe 2026-04-19 08:29:29,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1ef5d408ad4de248642ab 2026-04-19 08:29:29,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:29,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ef5d408ad4de248642ab HTTP/1.1" 200 None 2026-04-19 08:29:29,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:29,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 08:29:29,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:29,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1ef5d408ad4de248642ab HTTP/1.1" 200 None 2026-04-19 08:29:29,354 - lava_callback - ERROR - Error processing callback for node 69e1ef5d408ad4de248642ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:29:51,330 - lava_callback - INFO - Received callback for node 69e492047ab9251d5f9164ac INFO: 172.21.0.1:56474 - "POST /node/69e492047ab9251d5f9164ac HTTP/1.0" 202 Accepted 2026-04-19 08:29:51,336 - lava_callback - INFO - Starting async job submit for node 69e492047ab9251d5f9164ac 2026-04-19 08:29:51,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:51,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e492047ab9251d5f9164ac HTTP/1.1" 200 None 2026-04-19 08:29:51,374 - lava_callback - DEBUG - Processing node 69e492047ab9251d5f9164ac: baseline-arm 2026-04-19 08:29:51,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:29:51,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:29:51,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e492047ab9251d5f9164ac/log.txt.gz 2026-04-19 08:29:51,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:29:52,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:29:52,030 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e492047ab9251d5f9164ac/lava-logs.yaml 2026-04-19 08:29:52,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:29:52,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:29:52,147 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e492047ab9251d5f9164ac/lava_callback.json.gz 2026-04-19 08:29:52,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:52,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e492047ab9251d5f9164ac HTTP/1.1" 200 None 2026-04-19 08:29:52,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:52,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f4e7ab9251d5f915ea5 HTTP/1.1" 200 None 2026-04-19 08:29:52,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:52,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e492047ab9251d5f9164ac HTTP/1.1" 200 None 2026-04-19 08:29:52,253 - lava_callback - INFO - Completed processing callback for node 69e492047ab9251d5f9164ac INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:29:58,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:29:58,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:30:33,882 - lava_callback - INFO - Received callback for node 69e1efa2408ad4de248642d5 INFO: 172.21.0.1:40522 - "POST /node/69e1efa2408ad4de248642d5 HTTP/1.0" 202 Accepted 2026-04-19 08:30:33,889 - lava_callback - INFO - Starting async job submit for node 69e1efa2408ad4de248642d5 2026-04-19 08:30:33,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:30:33,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1efa2408ad4de248642d5 HTTP/1.1" 200 None 2026-04-19 08:30:33,908 - lava_callback - DEBUG - Processing node 69e1efa2408ad4de248642d5: baseline-arm64-baylibre 2026-04-19 08:30:33,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1efa2408ad4de248642d5 2026-04-19 08:30:33,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:30:33,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1efa2408ad4de248642d5 HTTP/1.1" 200 None 2026-04-19 08:30:33,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:30:33,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:30:33,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:30:34,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1efa2408ad4de248642d5 HTTP/1.1" 200 None 2026-04-19 08:30:34,021 - lava_callback - ERROR - Error processing callback for node 69e1efa2408ad4de248642d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:32:13,747 - lava_callback - INFO - Received callback for node 69e1f007408ad4de248642f4 INFO: 172.21.0.1:36608 - "POST /node/69e1f007408ad4de248642f4 HTTP/1.0" 202 Accepted 2026-04-19 08:32:13,752 - lava_callback - INFO - Starting async job submit for node 69e1f007408ad4de248642f4 2026-04-19 08:32:13,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:32:13,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f007408ad4de248642f4 HTTP/1.1" 200 None 2026-04-19 08:32:13,768 - lava_callback - DEBUG - Processing node 69e1f007408ad4de248642f4: baseline-arm64-baylibre 2026-04-19 08:32:13,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f007408ad4de248642f4 2026-04-19 08:32:13,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:32:13,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f007408ad4de248642f4 HTTP/1.1" 200 None 2026-04-19 08:32:13,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:32:13,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:32:13,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:32:13,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f007408ad4de248642f4 HTTP/1.1" 200 None 2026-04-19 08:32:13,817 - lava_callback - ERROR - Error processing callback for node 69e1f007408ad4de248642f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:33:33,794 - lava_callback - INFO - Received callback for node 69e1f04d408ad4de24864330 INFO: 172.21.0.1:46366 - "POST /node/69e1f04d408ad4de24864330 HTTP/1.0" 202 Accepted 2026-04-19 08:33:33,799 - lava_callback - INFO - Starting async job submit for node 69e1f04d408ad4de24864330 2026-04-19 08:33:33,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:33:33,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f04d408ad4de24864330 HTTP/1.1" 200 None 2026-04-19 08:33:33,815 - lava_callback - DEBUG - Processing node 69e1f04d408ad4de24864330: baseline-arm-baylibre 2026-04-19 08:33:33,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f04d408ad4de24864330 2026-04-19 08:33:33,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:33:33,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f04d408ad4de24864330 HTTP/1.1" 200 None 2026-04-19 08:33:33,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:33:33,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:33:33,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:33:33,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f04d408ad4de24864330 HTTP/1.1" 200 None 2026-04-19 08:33:33,885 - lava_callback - ERROR - Error processing callback for node 69e1f04d408ad4de24864330: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:34:13,802 - lava_callback - INFO - Received callback for node 69e1f072408ad4de24864343 INFO: 172.21.0.1:43230 - "POST /node/69e1f072408ad4de24864343 HTTP/1.0" 202 Accepted 2026-04-19 08:34:13,808 - lava_callback - INFO - Starting async job submit for node 69e1f072408ad4de24864343 2026-04-19 08:34:13,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:34:13,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f072408ad4de24864343 HTTP/1.1" 200 None 2026-04-19 08:34:13,830 - lava_callback - DEBUG - Processing node 69e1f072408ad4de24864343: baseline-arm-baylibre 2026-04-19 08:34:13,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f072408ad4de24864343 2026-04-19 08:34:13,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:34:13,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f072408ad4de24864343 HTTP/1.1" 200 None 2026-04-19 08:34:13,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:34:13,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:34:13,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:34:13,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f072408ad4de24864343 HTTP/1.1" 200 None 2026-04-19 08:34:13,878 - lava_callback - ERROR - Error processing callback for node 69e1f072408ad4de24864343: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48598 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:34:33,862 - lava_callback - INFO - Received callback for node 69e1f097408ad4de24864352 INFO: 172.21.0.1:57226 - "POST /node/69e1f097408ad4de24864352 HTTP/1.0" 202 Accepted 2026-04-19 08:34:33,868 - lava_callback - INFO - Starting async job submit for node 69e1f097408ad4de24864352 2026-04-19 08:34:33,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:34:33,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f097408ad4de24864352 HTTP/1.1" 200 None 2026-04-19 08:34:33,884 - lava_callback - DEBUG - Processing node 69e1f097408ad4de24864352: baseline-arm-baylibre 2026-04-19 08:34:33,884 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f097408ad4de24864352 2026-04-19 08:34:33,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:34:33,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f097408ad4de24864352 HTTP/1.1" 200 None 2026-04-19 08:34:33,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:34:33,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:34:33,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:34:33,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f097408ad4de24864352 HTTP/1.1" 200 None 2026-04-19 08:34:33,941 - lava_callback - ERROR - Error processing callback for node 69e1f097408ad4de24864352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:35:13,916 - lava_callback - INFO - Received callback for node 69e1f0bc408ad4de2486435f INFO: 172.21.0.1:40950 - "POST /node/69e1f0bc408ad4de2486435f HTTP/1.0" 202 Accepted 2026-04-19 08:35:13,922 - lava_callback - INFO - Starting async job submit for node 69e1f0bc408ad4de2486435f 2026-04-19 08:35:13,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:35:13,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f0bc408ad4de2486435f HTTP/1.1" 200 None 2026-04-19 08:35:13,938 - lava_callback - DEBUG - Processing node 69e1f0bc408ad4de2486435f: baseline-arm-baylibre 2026-04-19 08:35:13,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f0bc408ad4de2486435f 2026-04-19 08:35:13,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:35:13,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f0bc408ad4de2486435f HTTP/1.1" 200 None 2026-04-19 08:35:13,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:35:13,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:35:13,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:35:13,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f0bc408ad4de2486435f HTTP/1.1" 200 None 2026-04-19 08:35:13,997 - lava_callback - ERROR - Error processing callback for node 69e1f0bc408ad4de2486435f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:35:53,937 - lava_callback - INFO - Received callback for node 69e1f0e2408ad4de2486436b INFO: 172.21.0.1:43654 - "POST /node/69e1f0e2408ad4de2486436b HTTP/1.0" 202 Accepted 2026-04-19 08:35:53,942 - lava_callback - INFO - Starting async job submit for node 69e1f0e2408ad4de2486436b 2026-04-19 08:35:53,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:35:53,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f0e2408ad4de2486436b HTTP/1.1" 200 None 2026-04-19 08:35:53,957 - lava_callback - DEBUG - Processing node 69e1f0e2408ad4de2486436b: baseline-arm-baylibre 2026-04-19 08:35:53,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f0e2408ad4de2486436b 2026-04-19 08:35:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:35:53,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f0e2408ad4de2486436b HTTP/1.1" 200 None 2026-04-19 08:35:53,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:35:53,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:35:53,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:35:54,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f0e2408ad4de2486436b HTTP/1.1" 200 None 2026-04-19 08:35:54,020 - lava_callback - ERROR - Error processing callback for node 69e1f0e2408ad4de2486436b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51254 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:36:33,962 - lava_callback - INFO - Received callback for node 69e1f106408ad4de24864379 INFO: 172.21.0.1:42288 - "POST /node/69e1f106408ad4de24864379 HTTP/1.0" 202 Accepted 2026-04-19 08:36:33,968 - lava_callback - INFO - Starting async job submit for node 69e1f106408ad4de24864379 2026-04-19 08:36:33,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:36:34,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f106408ad4de24864379 HTTP/1.1" 200 None 2026-04-19 08:36:34,027 - lava_callback - DEBUG - Processing node 69e1f106408ad4de24864379: baseline-arm-baylibre 2026-04-19 08:36:34,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f106408ad4de24864379 2026-04-19 08:36:34,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:36:34,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f106408ad4de24864379 HTTP/1.1" 200 None 2026-04-19 08:36:34,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:36:34,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:36:34,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:36:34,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f106408ad4de24864379 HTTP/1.1" 200 None 2026-04-19 08:36:34,156 - lava_callback - ERROR - Error processing callback for node 69e1f106408ad4de24864379: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:37:09,642 - lava_callback - INFO - Received callback for node 69e1f12c408ad4de24864386 INFO: 172.21.0.1:33658 - "POST /node/69e1f12c408ad4de24864386 HTTP/1.0" 202 Accepted 2026-04-19 08:37:09,647 - lava_callback - INFO - Starting async job submit for node 69e1f12c408ad4de24864386 2026-04-19 08:37:09,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:37:09,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f12c408ad4de24864386 HTTP/1.1" 200 None 2026-04-19 08:37:09,667 - lava_callback - DEBUG - Processing node 69e1f12c408ad4de24864386: baseline-arm-clabbe 2026-04-19 08:37:09,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f12c408ad4de24864386 2026-04-19 08:37:09,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:37:09,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f12c408ad4de24864386 HTTP/1.1" 200 None 2026-04-19 08:37:09,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:37:09,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:37:09,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:37:09,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f12c408ad4de24864386 HTTP/1.1" 200 None 2026-04-19 08:37:09,714 - lava_callback - ERROR - Error processing callback for node 69e1f12c408ad4de24864386: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:37:49,603 - lava_callback - INFO - Received callback for node 69e1f151408ad4de24864391 INFO: 172.21.0.1:60456 - "POST /node/69e1f151408ad4de24864391 HTTP/1.0" 202 Accepted 2026-04-19 08:37:49,608 - lava_callback - INFO - Starting async job submit for node 69e1f151408ad4de24864391 2026-04-19 08:37:49,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:37:49,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f151408ad4de24864391 HTTP/1.1" 200 None 2026-04-19 08:37:49,626 - lava_callback - DEBUG - Processing node 69e1f151408ad4de24864391: baseline-arm-clabbe 2026-04-19 08:37:49,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f151408ad4de24864391 2026-04-19 08:37:49,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:37:49,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f151408ad4de24864391 HTTP/1.1" 200 None 2026-04-19 08:37:49,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:37:49,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:37:49,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:37:49,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f151408ad4de24864391 HTTP/1.1" 200 None 2026-04-19 08:37:49,675 - lava_callback - ERROR - Error processing callback for node 69e1f151408ad4de24864391: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:38:29,699 - lava_callback - INFO - Received callback for node 69e1f176408ad4de248643a0 INFO: 172.21.0.1:47390 - "POST /node/69e1f176408ad4de248643a0 HTTP/1.0" 202 Accepted 2026-04-19 08:38:29,705 - lava_callback - INFO - Starting async job submit for node 69e1f176408ad4de248643a0 2026-04-19 08:38:29,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:38:29,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f176408ad4de248643a0 HTTP/1.1" 200 None 2026-04-19 08:38:29,721 - lava_callback - DEBUG - Processing node 69e1f176408ad4de248643a0: baseline-arm-clabbe 2026-04-19 08:38:29,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f176408ad4de248643a0 2026-04-19 08:38:29,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:38:29,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f176408ad4de248643a0 HTTP/1.1" 200 None 2026-04-19 08:38:29,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:38:29,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:38:29,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:38:29,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f176408ad4de248643a0 HTTP/1.1" 200 None 2026-04-19 08:38:29,772 - lava_callback - ERROR - Error processing callback for node 69e1f176408ad4de248643a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:39:09,671 - lava_callback - INFO - Received callback for node 69e1f19b408ad4de248643ae INFO: 172.21.0.1:37106 - "POST /node/69e1f19b408ad4de248643ae HTTP/1.0" 202 Accepted 2026-04-19 08:39:09,676 - lava_callback - INFO - Starting async job submit for node 69e1f19b408ad4de248643ae 2026-04-19 08:39:09,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:39:09,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f19b408ad4de248643ae HTTP/1.1" 200 None 2026-04-19 08:39:09,692 - lava_callback - DEBUG - Processing node 69e1f19b408ad4de248643ae: baseline-arm-clabbe 2026-04-19 08:39:09,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f19b408ad4de248643ae 2026-04-19 08:39:09,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:39:09,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f19b408ad4de248643ae HTTP/1.1" 200 None 2026-04-19 08:39:09,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:39:09,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:39:09,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:39:09,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f19b408ad4de248643ae HTTP/1.1" 200 None 2026-04-19 08:39:09,743 - lava_callback - ERROR - Error processing callback for node 69e1f19b408ad4de248643ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:39:49,732 - lava_callback - INFO - Received callback for node 69e1f1c0408ad4de248643be INFO: 172.21.0.1:55530 - "POST /node/69e1f1c0408ad4de248643be HTTP/1.0" 202 Accepted 2026-04-19 08:39:49,738 - lava_callback - INFO - Starting async job submit for node 69e1f1c0408ad4de248643be 2026-04-19 08:39:49,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:39:49,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f1c0408ad4de248643be HTTP/1.1" 200 None 2026-04-19 08:39:49,755 - lava_callback - DEBUG - Processing node 69e1f1c0408ad4de248643be: baseline-arm-clabbe 2026-04-19 08:39:49,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f1c0408ad4de248643be 2026-04-19 08:39:49,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:39:49,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f1c0408ad4de248643be HTTP/1.1" 200 None 2026-04-19 08:39:49,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:39:49,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:39:49,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:39:49,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f1c0408ad4de248643be HTTP/1.1" 200 None 2026-04-19 08:39:49,806 - lava_callback - ERROR - Error processing callback for node 69e1f1c0408ad4de248643be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:40:34,525 - lava_callback - INFO - Received callback for node 69e1f1ec408ad4de248643c9 INFO: 172.21.0.1:34968 - "POST /node/69e1f1ec408ad4de248643c9 HTTP/1.0" 202 Accepted 2026-04-19 08:40:34,531 - lava_callback - INFO - Starting async job submit for node 69e1f1ec408ad4de248643c9 2026-04-19 08:40:34,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:40:34,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f1ec408ad4de248643c9 HTTP/1.1" 200 None 2026-04-19 08:40:34,547 - lava_callback - DEBUG - Processing node 69e1f1ec408ad4de248643c9: baseline-arm64-baylibre 2026-04-19 08:40:34,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f1ec408ad4de248643c9 2026-04-19 08:40:34,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:40:34,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f1ec408ad4de248643c9 HTTP/1.1" 200 None 2026-04-19 08:40:34,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:40:34,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:40:34,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:40:34,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f1ec408ad4de248643c9 HTTP/1.1" 200 None 2026-04-19 08:40:34,647 - lava_callback - ERROR - Error processing callback for node 69e1f1ec408ad4de248643c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41712 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:41:29,829 - lava_callback - INFO - Received callback for node 69e1f232408ad4de248643fe INFO: 172.21.0.1:38878 - "POST /node/69e1f232408ad4de248643fe HTTP/1.0" 202 Accepted 2026-04-19 08:41:29,834 - lava_callback - INFO - Starting async job submit for node 69e1f232408ad4de248643fe 2026-04-19 08:41:29,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:29,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f232408ad4de248643fe HTTP/1.1" 200 None 2026-04-19 08:41:29,854 - lava_callback - DEBUG - Processing node 69e1f232408ad4de248643fe: baseline-arm-clabbe 2026-04-19 08:41:29,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f232408ad4de248643fe 2026-04-19 08:41:29,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:29,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f232408ad4de248643fe HTTP/1.1" 200 None 2026-04-19 08:41:29,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:29,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:41:29,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:29,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f232408ad4de248643fe HTTP/1.1" 200 None 2026-04-19 08:41:29,901 - lava_callback - ERROR - Error processing callback for node 69e1f232408ad4de248643fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38884 - "GET /node/695197782df1719e393cb7ae%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-19 08:41:34,279 - lava_callback - INFO - Received callback for node 69e1f233408ad4de24864411 INFO: 172.21.0.1:38900 - "POST /node/69e1f233408ad4de24864411 HTTP/1.0" 202 Accepted 2026-04-19 08:41:34,285 - lava_callback - INFO - Starting async job submit for node 69e1f233408ad4de24864411 2026-04-19 08:41:34,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:34,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f233408ad4de24864411 HTTP/1.1" 200 None 2026-04-19 08:41:34,312 - lava_callback - DEBUG - Processing node 69e1f233408ad4de24864411: baseline-arm-baylibre 2026-04-19 08:41:34,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f233408ad4de24864411 2026-04-19 08:41:34,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:34,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f233408ad4de24864411 HTTP/1.1" 200 None 2026-04-19 08:41:34,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:34,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:34,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:34,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f233408ad4de24864411 HTTP/1.1" 200 None 2026-04-19 08:41:34,400 - lava_callback - ERROR - Error processing callback for node 69e1f233408ad4de24864411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:35,001 - lava_callback - INFO - Received callback for node 69e1f234408ad4de24864415 INFO: 172.21.0.1:38916 - "POST /node/69e1f234408ad4de24864415 HTTP/1.0" 202 Accepted 2026-04-19 08:41:35,010 - lava_callback - INFO - Starting async job submit for node 69e1f234408ad4de24864415 2026-04-19 08:41:35,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:35,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f234408ad4de24864415 HTTP/1.1" 200 None 2026-04-19 08:41:35,053 - lava_callback - DEBUG - Processing node 69e1f234408ad4de24864415: baseline-arm-baylibre 2026-04-19 08:41:35,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f234408ad4de24864415 2026-04-19 08:41:35,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:35,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f234408ad4de24864415 HTTP/1.1" 200 None 2026-04-19 08:41:35,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:35,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:35,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:35,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f234408ad4de24864415 HTTP/1.1" 200 None 2026-04-19 08:41:35,116 - lava_callback - ERROR - Error processing callback for node 69e1f234408ad4de24864415: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:35,676 - lava_callback - INFO - Received callback for node 69e1f235408ad4de24864418 INFO: 172.21.0.1:38928 - "POST /node/69e1f235408ad4de24864418 HTTP/1.0" 202 Accepted 2026-04-19 08:41:35,685 - lava_callback - INFO - Starting async job submit for node 69e1f235408ad4de24864418 2026-04-19 08:41:35,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:35,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f235408ad4de24864418 HTTP/1.1" 200 None 2026-04-19 08:41:35,710 - lava_callback - DEBUG - Processing node 69e1f235408ad4de24864418: baseline-arm-baylibre 2026-04-19 08:41:35,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f235408ad4de24864418 2026-04-19 08:41:35,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:35,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f235408ad4de24864418 HTTP/1.1" 200 None 2026-04-19 08:41:35,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:35,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:35,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:35,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f235408ad4de24864418 HTTP/1.1" 200 None 2026-04-19 08:41:35,801 - lava_callback - ERROR - Error processing callback for node 69e1f235408ad4de24864418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:36,348 - lava_callback - INFO - Received callback for node 69e1f236408ad4de2486441b INFO: 172.21.0.1:38934 - "POST /node/69e1f236408ad4de2486441b HTTP/1.0" 202 Accepted 2026-04-19 08:41:36,354 - lava_callback - INFO - Starting async job submit for node 69e1f236408ad4de2486441b 2026-04-19 08:41:36,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:36,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f236408ad4de2486441b HTTP/1.1" 200 None 2026-04-19 08:41:36,376 - lava_callback - DEBUG - Processing node 69e1f236408ad4de2486441b: baseline-arm-baylibre 2026-04-19 08:41:36,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f236408ad4de2486441b 2026-04-19 08:41:36,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:36,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f236408ad4de2486441b HTTP/1.1" 200 None 2026-04-19 08:41:36,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:36,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:36,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:36,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f236408ad4de2486441b HTTP/1.1" 200 None 2026-04-19 08:41:36,443 - lava_callback - ERROR - Error processing callback for node 69e1f236408ad4de2486441b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:41:37,018 - lava_callback - INFO - Received callback for node 69e1f239408ad4de24864426 INFO: 172.21.0.1:38952 - "POST /node/69e1f239408ad4de24864426 HTTP/1.0" 202 Accepted 2026-04-19 08:41:37,028 - lava_callback - INFO - Starting async job submit for node 69e1f239408ad4de24864426 2026-04-19 08:41:37,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:37,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f239408ad4de24864426 HTTP/1.1" 200 None 2026-04-19 08:41:37,056 - lava_callback - DEBUG - Processing node 69e1f239408ad4de24864426: baseline-arm-baylibre 2026-04-19 08:41:37,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f239408ad4de24864426 2026-04-19 08:41:37,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:37,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f239408ad4de24864426 HTTP/1.1" 200 None 2026-04-19 08:41:37,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:37,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:37,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:37,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f239408ad4de24864426 HTTP/1.1" 200 None 2026-04-19 08:41:37,150 - lava_callback - ERROR - Error processing callback for node 69e1f239408ad4de24864426: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:37,718 - lava_callback - INFO - Received callback for node 69e1f23a408ad4de24864429 INFO: 172.21.0.1:38968 - "POST /node/69e1f23a408ad4de24864429 HTTP/1.0" 202 Accepted 2026-04-19 08:41:37,724 - lava_callback - INFO - Starting async job submit for node 69e1f23a408ad4de24864429 2026-04-19 08:41:37,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:37,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f23a408ad4de24864429 HTTP/1.1" 200 None 2026-04-19 08:41:37,748 - lava_callback - DEBUG - Processing node 69e1f23a408ad4de24864429: baseline-arm-baylibre 2026-04-19 08:41:37,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f23a408ad4de24864429 2026-04-19 08:41:37,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:37,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f23a408ad4de24864429 HTTP/1.1" 200 None 2026-04-19 08:41:37,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:37,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:37,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:37,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f23a408ad4de24864429 HTTP/1.1" 200 None 2026-04-19 08:41:37,843 - lava_callback - ERROR - Error processing callback for node 69e1f23a408ad4de24864429: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:41:49,824 - lava_callback - INFO - Received callback for node 69e1f242408ad4de24864440 INFO: 172.21.0.1:37124 - "POST /node/69e1f242408ad4de24864440 HTTP/1.0" 202 Accepted 2026-04-19 08:41:49,834 - lava_callback - INFO - Starting async job submit for node 69e1f242408ad4de24864440 2026-04-19 08:41:49,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:49,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f242408ad4de24864440 HTTP/1.1" 200 None 2026-04-19 08:41:49,866 - lava_callback - DEBUG - Processing node 69e1f242408ad4de24864440: baseline-arm-clabbe 2026-04-19 08:41:49,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f242408ad4de24864440 2026-04-19 08:41:49,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:49,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f242408ad4de24864440 HTTP/1.1" 200 None 2026-04-19 08:41:49,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:49,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:49,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:49,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f242408ad4de24864440 HTTP/1.1" 200 None 2026-04-19 08:41:49,993 - lava_callback - ERROR - Error processing callback for node 69e1f242408ad4de24864440: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:50,500 - lava_callback - INFO - Received callback for node 69e1f243408ad4de24864446 INFO: 172.21.0.1:37130 - "POST /node/69e1f243408ad4de24864446 HTTP/1.0" 202 Accepted 2026-04-19 08:41:50,511 - lava_callback - INFO - Starting async job submit for node 69e1f243408ad4de24864446 2026-04-19 08:41:50,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:50,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f243408ad4de24864446 HTTP/1.1" 200 None 2026-04-19 08:41:50,548 - lava_callback - DEBUG - Processing node 69e1f243408ad4de24864446: baseline-arm-clabbe 2026-04-19 08:41:50,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f243408ad4de24864446 2026-04-19 08:41:50,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:50,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f243408ad4de24864446 HTTP/1.1" 200 None 2026-04-19 08:41:50,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:50,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:50,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:50,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f243408ad4de24864446 HTTP/1.1" 200 None 2026-04-19 08:41:50,655 - lava_callback - ERROR - Error processing callback for node 69e1f243408ad4de24864446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:51,189 - lava_callback - INFO - Received callback for node 69e1f244408ad4de2486444a INFO: 172.21.0.1:37136 - "POST /node/69e1f244408ad4de2486444a HTTP/1.0" 202 Accepted 2026-04-19 08:41:51,198 - lava_callback - INFO - Starting async job submit for node 69e1f244408ad4de2486444a 2026-04-19 08:41:51,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:51,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f244408ad4de2486444a HTTP/1.1" 200 None 2026-04-19 08:41:51,227 - lava_callback - DEBUG - Processing node 69e1f244408ad4de2486444a: baseline-arm-clabbe 2026-04-19 08:41:51,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f244408ad4de2486444a 2026-04-19 08:41:51,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:51,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f244408ad4de2486444a HTTP/1.1" 200 None 2026-04-19 08:41:51,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:51,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:51,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:51,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f244408ad4de2486444a HTTP/1.1" 200 None 2026-04-19 08:41:51,337 - lava_callback - ERROR - Error processing callback for node 69e1f244408ad4de2486444a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:51,878 - lava_callback - INFO - Received callback for node 69e1f245408ad4de2486444d INFO: 172.21.0.1:37140 - "POST /node/69e1f245408ad4de2486444d HTTP/1.0" 202 Accepted 2026-04-19 08:41:51,889 - lava_callback - INFO - Starting async job submit for node 69e1f245408ad4de2486444d 2026-04-19 08:41:51,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:51,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f245408ad4de2486444d HTTP/1.1" 200 None 2026-04-19 08:41:51,922 - lava_callback - DEBUG - Processing node 69e1f245408ad4de2486444d: baseline-arm-clabbe 2026-04-19 08:41:51,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f245408ad4de2486444d 2026-04-19 08:41:51,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:51,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f245408ad4de2486444d HTTP/1.1" 200 None 2026-04-19 08:41:51,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:52,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:52,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:52,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f245408ad4de2486444d HTTP/1.1" 200 None 2026-04-19 08:41:52,053 - lava_callback - ERROR - Error processing callback for node 69e1f245408ad4de2486444d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:52,554 - lava_callback - INFO - Received callback for node 69e1f246408ad4de24864450 INFO: 172.21.0.1:37142 - "POST /node/69e1f246408ad4de24864450 HTTP/1.0" 202 Accepted 2026-04-19 08:41:52,566 - lava_callback - INFO - Starting async job submit for node 69e1f246408ad4de24864450 2026-04-19 08:41:52,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:52,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f246408ad4de24864450 HTTP/1.1" 200 None 2026-04-19 08:41:52,593 - lava_callback - DEBUG - Processing node 69e1f246408ad4de24864450: baseline-arm-clabbe 2026-04-19 08:41:52,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f246408ad4de24864450 2026-04-19 08:41:52,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:52,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f246408ad4de24864450 HTTP/1.1" 200 None 2026-04-19 08:41:52,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:52,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:52,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:52,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f246408ad4de24864450 HTTP/1.1" 200 None 2026-04-19 08:41:52,695 - lava_callback - ERROR - Error processing callback for node 69e1f246408ad4de24864450: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:53,249 - lava_callback - INFO - Received callback for node 69e1f247408ad4de24864453 INFO: 172.21.0.1:37152 - "POST /node/69e1f247408ad4de24864453 HTTP/1.0" 202 Accepted 2026-04-19 08:41:53,261 - lava_callback - INFO - Starting async job submit for node 69e1f247408ad4de24864453 2026-04-19 08:41:53,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:53,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f247408ad4de24864453 HTTP/1.1" 200 None 2026-04-19 08:41:53,287 - lava_callback - DEBUG - Processing node 69e1f247408ad4de24864453: baseline-arm-clabbe 2026-04-19 08:41:53,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f247408ad4de24864453 2026-04-19 08:41:53,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:53,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f247408ad4de24864453 HTTP/1.1" 200 None 2026-04-19 08:41:53,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:53,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:53,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:53,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f247408ad4de24864453 HTTP/1.1" 200 None 2026-04-19 08:41:53,400 - lava_callback - ERROR - Error processing callback for node 69e1f247408ad4de24864453: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:53,951 - lava_callback - INFO - Received callback for node 69e1f248408ad4de24864456 INFO: 172.21.0.1:37160 - "POST /node/69e1f248408ad4de24864456 HTTP/1.0" 202 Accepted 2026-04-19 08:41:53,959 - lava_callback - INFO - Starting async job submit for node 69e1f248408ad4de24864456 2026-04-19 08:41:53,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:54,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f248408ad4de24864456 HTTP/1.1" 200 None 2026-04-19 08:41:54,009 - lava_callback - DEBUG - Processing node 69e1f248408ad4de24864456: baseline-arm-clabbe 2026-04-19 08:41:54,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f248408ad4de24864456 2026-04-19 08:41:54,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:54,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f248408ad4de24864456 HTTP/1.1" 200 None 2026-04-19 08:41:54,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:54,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:54,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:54,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f248408ad4de24864456 HTTP/1.1" 200 None 2026-04-19 08:41:54,158 - lava_callback - ERROR - Error processing callback for node 69e1f248408ad4de24864456: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:54,647 - lava_callback - INFO - Received callback for node 69e1f249408ad4de24864459 INFO: 172.21.0.1:37172 - "POST /node/69e1f249408ad4de24864459 HTTP/1.0" 202 Accepted 2026-04-19 08:41:54,657 - lava_callback - INFO - Starting async job submit for node 69e1f249408ad4de24864459 2026-04-19 08:41:54,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:54,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f249408ad4de24864459 HTTP/1.1" 200 None 2026-04-19 08:41:54,692 - lava_callback - DEBUG - Processing node 69e1f249408ad4de24864459: baseline-arm-clabbe 2026-04-19 08:41:54,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f249408ad4de24864459 2026-04-19 08:41:54,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:54,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f249408ad4de24864459 HTTP/1.1" 200 None 2026-04-19 08:41:54,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:54,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:54,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:54,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f249408ad4de24864459 HTTP/1.1" 200 None 2026-04-19 08:41:54,786 - lava_callback - ERROR - Error processing callback for node 69e1f249408ad4de24864459: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:41:55,312 - lava_callback - INFO - Received callback for node 69e1f24a408ad4de2486445c INFO: 172.21.0.1:37178 - "POST /node/69e1f24a408ad4de2486445c HTTP/1.0" 202 Accepted 2026-04-19 08:41:55,323 - lava_callback - INFO - Starting async job submit for node 69e1f24a408ad4de2486445c 2026-04-19 08:41:55,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:55,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f24a408ad4de2486445c HTTP/1.1" 200 None 2026-04-19 08:41:55,366 - lava_callback - DEBUG - Processing node 69e1f24a408ad4de2486445c: baseline-arm-clabbe 2026-04-19 08:41:55,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f24a408ad4de2486445c 2026-04-19 08:41:55,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:55,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f24a408ad4de2486445c HTTP/1.1" 200 None 2026-04-19 08:41:55,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:55,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 08:41:55,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:41:55,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f24a408ad4de2486445c HTTP/1.1" 200 None 2026-04-19 08:41:55,480 - lava_callback - ERROR - Error processing callback for node 69e1f24a408ad4de2486445c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:42:09,816 - lava_callback - INFO - Received callback for node 69e1f258408ad4de248644aa INFO: 172.21.0.1:37306 - "POST /node/69e1f258408ad4de248644aa HTTP/1.0" 202 Accepted 2026-04-19 08:42:09,827 - lava_callback - INFO - Starting async job submit for node 69e1f258408ad4de248644aa 2026-04-19 08:42:09,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:42:09,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f258408ad4de248644aa HTTP/1.1" 200 None 2026-04-19 08:42:09,870 - lava_callback - DEBUG - Processing node 69e1f258408ad4de248644aa: baseline-arm-clabbe 2026-04-19 08:42:09,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f258408ad4de248644aa 2026-04-19 08:42:09,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:42:09,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f258408ad4de248644aa HTTP/1.1" 200 None 2026-04-19 08:42:09,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:42:09,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:42:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:42:09,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f258408ad4de248644aa HTTP/1.1" 200 None 2026-04-19 08:42:09,955 - lava_callback - ERROR - Error processing callback for node 69e1f258408ad4de248644aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:42:49,944 - lava_callback - INFO - Received callback for node 69e1f27e408ad4de248644fe INFO: 172.21.0.1:46948 - "POST /node/69e1f27e408ad4de248644fe HTTP/1.0" 202 Accepted 2026-04-19 08:42:49,950 - lava_callback - INFO - Starting async job submit for node 69e1f27e408ad4de248644fe 2026-04-19 08:42:49,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:42:49,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f27e408ad4de248644fe HTTP/1.1" 200 None 2026-04-19 08:42:49,967 - lava_callback - DEBUG - Processing node 69e1f27e408ad4de248644fe: baseline-arm-clabbe 2026-04-19 08:42:49,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f27e408ad4de248644fe 2026-04-19 08:42:49,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:42:49,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f27e408ad4de248644fe HTTP/1.1" 200 None 2026-04-19 08:42:49,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:42:50,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:42:50,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:42:50,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f27e408ad4de248644fe HTTP/1.1" 200 None 2026-04-19 08:42:50,042 - lava_callback - ERROR - Error processing callback for node 69e1f27e408ad4de248644fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET /node/694bd160c19e09af58d47d68%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-19 08:43:23,662 - lava_callback - INFO - Received callback for node 69e495997ab9251d5f9165c8 INFO: 172.21.0.1:33734 - "POST /node/69e495997ab9251d5f9165c8 HTTP/1.0" 202 Accepted 2026-04-19 08:43:23,668 - lava_callback - INFO - Starting async job submit for node 69e495997ab9251d5f9165c8 2026-04-19 08:43:23,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:23,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495997ab9251d5f9165c8 HTTP/1.1" 200 None 2026-04-19 08:43:23,692 - lava_callback - DEBUG - Processing node 69e495997ab9251d5f9165c8: baseline-arm 2026-04-19 08:43:23,697 - lava_callback - WARNING - Failed to upload log 2026-04-19 08:43:23,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:43:23,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:43:23,803 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e495997ab9251d5f9165c8/lava-logs.yaml 2026-04-19 08:43:23,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:43:23,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:43:23,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e495997ab9251d5f9165c8/lava_callback.json.gz 2026-04-19 08:43:23,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:23,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495997ab9251d5f9165c8 HTTP/1.1" 200 None 2026-04-19 08:43:23,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:23,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:43:23,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:24,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495997ab9251d5f9165c8 HTTP/1.1" 200 None 2026-04-19 08:43:24,011 - lava_callback - INFO - Completed processing callback for node 69e495997ab9251d5f9165c8 INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:43:28,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:28,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-19 08:43:29,840 - lava_callback - INFO - Received callback for node 69e1f2a6408ad4de2486452f INFO: 172.21.0.1:48524 - "POST /node/69e1f2a6408ad4de2486452f HTTP/1.0" 202 Accepted 2026-04-19 08:43:29,850 - lava_callback - INFO - Starting async job submit for node 69e1f2a6408ad4de2486452f 2026-04-19 08:43:29,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:29,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f2a6408ad4de2486452f HTTP/1.1" 200 None 2026-04-19 08:43:29,873 - lava_callback - DEBUG - Processing node 69e1f2a6408ad4de2486452f: baseline-arm-clabbe 2026-04-19 08:43:29,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f2a6408ad4de2486452f 2026-04-19 08:43:29,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:29,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f2a6408ad4de2486452f HTTP/1.1" 200 None 2026-04-19 08:43:29,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:29,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 08:43:29,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:29,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f2a6408ad4de2486452f HTTP/1.1" 200 None 2026-04-19 08:43:29,946 - lava_callback - ERROR - Error processing callback for node 69e1f2a6408ad4de2486452f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:43:31,474 - lava_callback - INFO - Received callback for node 69e495997ab9251d5f9165cb INFO: 172.21.0.1:48530 - "POST /node/69e495997ab9251d5f9165cb HTTP/1.0" 202 Accepted 2026-04-19 08:43:31,523 - lava_callback - INFO - Starting async job submit for node 69e495997ab9251d5f9165cb 2026-04-19 08:43:31,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:31,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495997ab9251d5f9165cb HTTP/1.1" 200 None 2026-04-19 08:43:31,556 - lava_callback - DEBUG - Processing node 69e495997ab9251d5f9165cb: baseline-arm 2026-04-19 08:43:31,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:43:31,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:43:31,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e495997ab9251d5f9165cb/log.txt.gz 2026-04-19 08:43:31,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:43:31,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:43:31,955 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e495997ab9251d5f9165cb/lava-logs.yaml 2026-04-19 08:43:31,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:43:32,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:43:32,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e495997ab9251d5f9165cb/lava_callback.json.gz 2026-04-19 08:43:32,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:32,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495997ab9251d5f9165cb HTTP/1.1" 200 None 2026-04-19 08:43:32,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:32,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:43:32,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:32,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495997ab9251d5f9165cb HTTP/1.1" 200 None 2026-04-19 08:43:32,219 - lava_callback - INFO - Completed processing callback for node 69e495997ab9251d5f9165cb INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60568 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:43:46,074 - lava_callback - INFO - Received callback for node 69e4959c7ab9251d5f9165d4 INFO: 172.21.0.1:60570 - "POST /node/69e4959c7ab9251d5f9165d4 HTTP/1.0" 202 Accepted 2026-04-19 08:43:46,122 - lava_callback - INFO - Starting async job submit for node 69e4959c7ab9251d5f9165d4 2026-04-19 08:43:46,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:46,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4959c7ab9251d5f9165d4 HTTP/1.1" 200 None 2026-04-19 08:43:46,161 - lava_callback - DEBUG - Processing node 69e4959c7ab9251d5f9165d4: baseline-arm 2026-04-19 08:43:46,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:43:46,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:43:46,425 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959c7ab9251d5f9165d4/log.txt.gz INFO: 172.21.0.1:60572 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:43:46,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:43:46,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:43:46,677 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959c7ab9251d5f9165d4/lava-logs.yaml 2026-04-19 08:43:46,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:43:46,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:43:46,769 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959c7ab9251d5f9165d4/lava_callback.json.gz 2026-04-19 08:43:46,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:46,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4959c7ab9251d5f9165d4 HTTP/1.1" 200 None 2026-04-19 08:43:46,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:46,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:43:46,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:46,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4959c7ab9251d5f9165d4 HTTP/1.1" 200 None 2026-04-19 08:43:46,870 - lava_callback - INFO - Completed processing callback for node 69e4959c7ab9251d5f9165d4 INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:43:58,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:43:58,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:44:14,423 - lava_callback - INFO - Received callback for node 69e1f2d4408ad4de2486455f INFO: 172.21.0.1:49612 - "POST /node/69e1f2d4408ad4de2486455f HTTP/1.0" 202 Accepted 2026-04-19 08:44:14,428 - lava_callback - INFO - Starting async job submit for node 69e1f2d4408ad4de2486455f 2026-04-19 08:44:14,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:14,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f2d4408ad4de2486455f HTTP/1.1" 200 None 2026-04-19 08:44:14,452 - lava_callback - DEBUG - Processing node 69e1f2d4408ad4de2486455f: baseline-arm64-baylibre 2026-04-19 08:44:14,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f2d4408ad4de2486455f 2026-04-19 08:44:14,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:14,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f2d4408ad4de2486455f HTTP/1.1" 200 None 2026-04-19 08:44:14,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:14,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:44:14,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:14,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f2d4408ad4de2486455f HTTP/1.1" 200 None 2026-04-19 08:44:14,509 - lava_callback - ERROR - Error processing callback for node 69e1f2d4408ad4de2486455f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:44:28,116 - lava_callback - INFO - Received callback for node 69e495987ab9251d5f9165c5 INFO: 172.21.0.1:60570 - "POST /node/69e495987ab9251d5f9165c5 HTTP/1.0" 202 Accepted 2026-04-19 08:44:28,122 - lava_callback - INFO - Starting async job submit for node 69e495987ab9251d5f9165c5 2026-04-19 08:44:28,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:28,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495987ab9251d5f9165c5 HTTP/1.1" 200 None 2026-04-19 08:44:28,169 - lava_callback - DEBUG - Processing node 69e495987ab9251d5f9165c5: baseline-arm 2026-04-19 08:44:28,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:28,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:28,429 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e495987ab9251d5f9165c5/log.txt.gz 2026-04-19 08:44:28,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:28,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:28,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e495987ab9251d5f9165c5/lava-logs.yaml 2026-04-19 08:44:28,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:28,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:28,830 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e495987ab9251d5f9165c5/lava_callback.json.gz 2026-04-19 08:44:28,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:28,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495987ab9251d5f9165c5 HTTP/1.1" 200 None 2026-04-19 08:44:28,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:28,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:44:28,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:28,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495987ab9251d5f9165c5 HTTP/1.1" 200 None 2026-04-19 08:44:28,912 - lava_callback - INFO - Completed processing callback for node 69e495987ab9251d5f9165c5 2026-04-19 08:44:33,045 - lava_callback - INFO - Received callback for node 69e4959b7ab9251d5f9165d1 INFO: 172.21.0.1:53918 - "POST /node/69e4959b7ab9251d5f9165d1 HTTP/1.0" 202 Accepted 2026-04-19 08:44:33,052 - lava_callback - INFO - Starting async job submit for node 69e4959b7ab9251d5f9165d1 2026-04-19 08:44:33,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:33,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4959b7ab9251d5f9165d1 HTTP/1.1" 200 None 2026-04-19 08:44:33,102 - lava_callback - DEBUG - Processing node 69e4959b7ab9251d5f9165d1: baseline-arm 2026-04-19 08:44:33,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:33,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:33,450 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959b7ab9251d5f9165d1/log.txt.gz 2026-04-19 08:44:33,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:33,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:33,762 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959b7ab9251d5f9165d1/lava-logs.yaml 2026-04-19 08:44:33,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:33,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:33,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959b7ab9251d5f9165d1/lava_callback.json.gz 2026-04-19 08:44:33,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:33,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4959b7ab9251d5f9165d1 HTTP/1.1" 200 None 2026-04-19 08:44:33,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:33,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:44:33,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:33,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4959b7ab9251d5f9165d1 HTTP/1.1" 200 None 2026-04-19 08:44:33,991 - lava_callback - INFO - Completed processing callback for node 69e4959b7ab9251d5f9165d1 INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:44:37,431 - lava_callback - INFO - Received callback for node 69e495bd7ab9251d5f916668 INFO: 172.21.0.1:53938 - "POST /node/69e495bd7ab9251d5f916668 HTTP/1.0" 202 Accepted 2026-04-19 08:44:37,478 - lava_callback - INFO - Starting async job submit for node 69e495bd7ab9251d5f916668 2026-04-19 08:44:37,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:37,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495bd7ab9251d5f916668 HTTP/1.1" 200 None 2026-04-19 08:44:37,538 - lava_callback - DEBUG - Processing node 69e495bd7ab9251d5f916668: baseline-arm-pengutronix 2026-04-19 08:44:37,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:37,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:37,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bd7ab9251d5f916668/log.txt.gz 2026-04-19 08:44:37,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:38,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:38,082 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bd7ab9251d5f916668/lava-logs.yaml 2026-04-19 08:44:38,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:38,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:38,184 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bd7ab9251d5f916668/lava_callback.json.gz 2026-04-19 08:44:38,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:38,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495bd7ab9251d5f916668 HTTP/1.1" 200 None 2026-04-19 08:44:38,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:38,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:44:38,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:38,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495bd7ab9251d5f916668 HTTP/1.1" 200 None 2026-04-19 08:44:38,305 - lava_callback - INFO - Completed processing callback for node 69e495bd7ab9251d5f916668 2026-04-19 08:44:42,265 - lava_callback - INFO - Received callback for node 69e495bb7ab9251d5f916662 INFO: 172.21.0.1:47402 - "POST /node/69e495bb7ab9251d5f916662 HTTP/1.0" 202 Accepted 2026-04-19 08:44:42,272 - lava_callback - INFO - Starting async job submit for node 69e495bb7ab9251d5f916662 2026-04-19 08:44:42,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:42,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495bb7ab9251d5f916662 HTTP/1.1" 200 None 2026-04-19 08:44:42,322 - lava_callback - DEBUG - Processing node 69e495bb7ab9251d5f916662: baseline-arm-pengutronix 2026-04-19 08:44:42,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:42,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:42,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bb7ab9251d5f916662/log.txt.gz 2026-04-19 08:44:42,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:42,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:42,867 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bb7ab9251d5f916662/lava-logs.yaml 2026-04-19 08:44:42,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:42,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:42,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bb7ab9251d5f916662/lava_callback.json.gz 2026-04-19 08:44:42,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:43,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495bb7ab9251d5f916662 HTTP/1.1" 200 None 2026-04-19 08:44:43,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:43,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:44:43,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:43,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495bb7ab9251d5f916662 HTTP/1.1" 200 None 2026-04-19 08:44:43,066 - lava_callback - INFO - Completed processing callback for node 69e495bb7ab9251d5f916662 INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:44:51,714 - lava_callback - INFO - Received callback for node 69e495a97ab9251d5f9165f4 INFO: 172.21.0.1:50994 - "POST /node/69e495a97ab9251d5f9165f4 HTTP/1.0" 202 Accepted 2026-04-19 08:44:51,724 - lava_callback - INFO - Starting async job submit for node 69e495a97ab9251d5f9165f4 2026-04-19 08:44:51,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:51,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495a97ab9251d5f9165f4 HTTP/1.1" 200 None 2026-04-19 08:44:51,798 - lava_callback - DEBUG - Processing node 69e495a97ab9251d5f9165f4: baseline-arm-broonie 2026-04-19 08:44:52,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:52,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:52,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495a97ab9251d5f9165f4/log.txt.gz 2026-04-19 08:44:52,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:52,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:52,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495a97ab9251d5f9165f4/lava-logs.yaml 2026-04-19 08:44:52,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:44:52,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:44:52,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495a97ab9251d5f9165f4/lava_callback.json.gz 2026-04-19 08:44:52,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:52,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495a97ab9251d5f9165f4 HTTP/1.1" 200 None 2026-04-19 08:44:52,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:52,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:44:52,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:52,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495a97ab9251d5f9165f4 HTTP/1.1" 200 None 2026-04-19 08:44:52,737 - lava_callback - INFO - Completed processing callback for node 69e495a97ab9251d5f9165f4 INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:44:58,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:44:58,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:45:08,845 - lava_callback - INFO - Received callback for node 69e495ab7ab9251d5f9165fa INFO: 172.21.0.1:59134 - "POST /node/69e495ab7ab9251d5f9165fa HTTP/1.0" 202 Accepted 2026-04-19 08:45:08,855 - lava_callback - INFO - Starting async job submit for node 69e495ab7ab9251d5f9165fa 2026-04-19 08:45:08,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:08,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495ab7ab9251d5f9165fa HTTP/1.1" 200 None 2026-04-19 08:45:08,916 - lava_callback - DEBUG - Processing node 69e495ab7ab9251d5f9165fa: baseline-arm-broonie 2026-04-19 08:45:09,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:09,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:09,274 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495ab7ab9251d5f9165fa/log.txt.gz 2026-04-19 08:45:09,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:09,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:09,585 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495ab7ab9251d5f9165fa/lava-logs.yaml 2026-04-19 08:45:09,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:09,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:09,684 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495ab7ab9251d5f9165fa/lava_callback.json.gz 2026-04-19 08:45:09,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:09,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495ab7ab9251d5f9165fa HTTP/1.1" 200 None 2026-04-19 08:45:09,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:09,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:45:09,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:09,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495ab7ab9251d5f9165fa HTTP/1.1" 200 None 2026-04-19 08:45:09,800 - lava_callback - INFO - Completed processing callback for node 69e495ab7ab9251d5f9165fa 2026-04-19 08:45:12,002 - lava_callback - INFO - Received callback for node 69e495aa7ab9251d5f9165f7 INFO: 172.21.0.1:49488 - "POST /node/69e495aa7ab9251d5f9165f7 HTTP/1.0" 202 Accepted 2026-04-19 08:45:12,009 - lava_callback - INFO - Starting async job submit for node 69e495aa7ab9251d5f9165f7 2026-04-19 08:45:12,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:12,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495aa7ab9251d5f9165f7 HTTP/1.1" 200 None 2026-04-19 08:45:12,050 - lava_callback - DEBUG - Processing node 69e495aa7ab9251d5f9165f7: baseline-arm-broonie 2026-04-19 08:45:12,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:12,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:12,452 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495aa7ab9251d5f9165f7/log.txt.gz 2026-04-19 08:45:12,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:12,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:12,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495aa7ab9251d5f9165f7/lava-logs.yaml 2026-04-19 08:45:12,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:12,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:12,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495aa7ab9251d5f9165f7/lava_callback.json.gz 2026-04-19 08:45:12,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:12,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495aa7ab9251d5f9165f7 HTTP/1.1" 200 None 2026-04-19 08:45:12,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:12,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:45:12,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:12,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495aa7ab9251d5f9165f7 HTTP/1.1" 200 None 2026-04-19 08:45:12,954 - lava_callback - INFO - Completed processing callback for node 69e495aa7ab9251d5f9165f7 2026-04-19 08:45:13,821 - lava_callback - INFO - Received callback for node 69e495b67ab9251d5f916654 INFO: 172.21.0.1:49496 - "POST /node/69e495b67ab9251d5f916654 HTTP/1.0" 202 Accepted 2026-04-19 08:45:13,831 - lava_callback - INFO - Starting async job submit for node 69e495b67ab9251d5f916654 2026-04-19 08:45:13,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:13,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495b67ab9251d5f916654 HTTP/1.1" 200 None 2026-04-19 08:45:13,890 - lava_callback - DEBUG - Processing node 69e495b67ab9251d5f916654: baseline-arm-kontron 2026-04-19 08:45:14,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:14,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:14,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e495b67ab9251d5f916654/log.txt.gz 2026-04-19 08:45:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:14,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:14,597 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e495b67ab9251d5f916654/lava-logs.yaml 2026-04-19 08:45:14,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:14,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:14,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e495b67ab9251d5f916654/lava_callback.json.gz 2026-04-19 08:45:14,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:14,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495b67ab9251d5f916654 HTTP/1.1" 200 None 2026-04-19 08:45:14,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:14,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:45:14,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:14,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495b67ab9251d5f916654 HTTP/1.1" 200 None 2026-04-19 08:45:14,780 - lava_callback - INFO - Completed processing callback for node 69e495b67ab9251d5f916654 2026-04-19 08:45:15,096 - lava_callback - INFO - Received callback for node 69e495b77ab9251d5f916657 INFO: 172.21.0.1:49508 - "POST /node/69e495b77ab9251d5f916657 HTTP/1.0" 202 Accepted 2026-04-19 08:45:15,103 - lava_callback - INFO - Starting async job submit for node 69e495b77ab9251d5f916657 2026-04-19 08:45:15,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:15,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495b77ab9251d5f916657 HTTP/1.1" 200 None 2026-04-19 08:45:15,157 - lava_callback - DEBUG - Processing node 69e495b77ab9251d5f916657: baseline-arm-kontron INFO: 172.21.0.1:49516 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 08:45:15,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:15,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:15,458 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e495b77ab9251d5f916657/log.txt.gz 2026-04-19 08:45:15,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:15,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:15,744 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e495b77ab9251d5f916657/lava-logs.yaml 2026-04-19 08:45:15,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:15,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:15,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e495b77ab9251d5f916657/lava_callback.json.gz 2026-04-19 08:45:15,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:15,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495b77ab9251d5f916657 HTTP/1.1" 200 None 2026-04-19 08:45:15,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:15,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:45:15,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:16,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495b77ab9251d5f916657 HTTP/1.1" 200 None 2026-04-19 08:45:16,012 - lava_callback - INFO - Completed processing callback for node 69e495b77ab9251d5f916657 INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54866 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:45:28,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:28,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-19 08:45:31,882 - lava_callback - INFO - Received callback for node 69e495a77ab9251d5f9165f1 INFO: 172.21.0.1:52792 - "POST /node/69e495a77ab9251d5f9165f1 HTTP/1.0" 202 Accepted 2026-04-19 08:45:31,890 - lava_callback - INFO - Starting async job submit for node 69e495a77ab9251d5f9165f1 2026-04-19 08:45:31,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:31,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495a77ab9251d5f9165f1 HTTP/1.1" 200 None 2026-04-19 08:45:31,948 - lava_callback - DEBUG - Processing node 69e495a77ab9251d5f9165f1: baseline-arm-broonie 2026-04-19 08:45:32,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:32,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:32,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495a77ab9251d5f9165f1/log.txt.gz 2026-04-19 08:45:32,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:32,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:32,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495a77ab9251d5f9165f1/lava-logs.yaml 2026-04-19 08:45:32,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:32,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:32,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e495a77ab9251d5f9165f1/lava_callback.json.gz 2026-04-19 08:45:32,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:32,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495a77ab9251d5f9165f1 HTTP/1.1" 200 None 2026-04-19 08:45:32,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:32,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:45:32,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:32,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495a77ab9251d5f9165f1 HTTP/1.1" 200 None 2026-04-19 08:45:32,911 - lava_callback - INFO - Completed processing callback for node 69e495a77ab9251d5f9165f1 2026-04-19 08:45:34,864 - lava_callback - INFO - Received callback for node 69e1f321408ad4de24864596 INFO: 172.21.0.1:52804 - "POST /node/69e1f321408ad4de24864596 HTTP/1.0" 202 Accepted 2026-04-19 08:45:34,870 - lava_callback - INFO - Starting async job submit for node 69e1f321408ad4de24864596 2026-04-19 08:45:34,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:34,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f321408ad4de24864596 HTTP/1.1" 200 None 2026-04-19 08:45:34,887 - lava_callback - DEBUG - Processing node 69e1f321408ad4de24864596: baseline-arm64-baylibre 2026-04-19 08:45:34,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f321408ad4de24864596 2026-04-19 08:45:34,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:34,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f321408ad4de24864596 HTTP/1.1" 200 None 2026-04-19 08:45:34,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:34,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:45:34,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:34,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f321408ad4de24864596 HTTP/1.1" 200 None 2026-04-19 08:45:34,972 - lava_callback - ERROR - Error processing callback for node 69e1f321408ad4de24864596: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:45:41,738 - lava_callback - INFO - Received callback for node 69e495bc7ab9251d5f916665 INFO: 172.21.0.1:49420 - "POST /node/69e495bc7ab9251d5f916665 HTTP/1.0" 202 Accepted 2026-04-19 08:45:41,745 - lava_callback - INFO - Starting async job submit for node 69e495bc7ab9251d5f916665 2026-04-19 08:45:41,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:41,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495bc7ab9251d5f916665 HTTP/1.1" 200 None 2026-04-19 08:45:41,799 - lava_callback - DEBUG - Processing node 69e495bc7ab9251d5f916665: baseline-arm-pengutronix 2026-04-19 08:45:41,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:42,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:42,064 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bc7ab9251d5f916665/log.txt.gz 2026-04-19 08:45:42,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:42,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:42,299 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bc7ab9251d5f916665/lava-logs.yaml 2026-04-19 08:45:42,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:42,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:42,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e495bc7ab9251d5f916665/lava_callback.json.gz 2026-04-19 08:45:42,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:42,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495bc7ab9251d5f916665 HTTP/1.1" 200 None 2026-04-19 08:45:42,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:42,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:45:42,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:42,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495bc7ab9251d5f916665 HTTP/1.1" 200 None 2026-04-19 08:45:42,564 - lava_callback - INFO - Completed processing callback for node 69e495bc7ab9251d5f916665 INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:45:56,420 - lava_callback - INFO - Received callback for node 69e495d47ab9251d5f91669e INFO: 172.21.0.1:55054 - "POST /node/69e495d47ab9251d5f91669e HTTP/1.0" 202 Accepted 2026-04-19 08:45:56,427 - lava_callback - INFO - Starting async job submit for node 69e495d47ab9251d5f91669e 2026-04-19 08:45:56,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:56,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d47ab9251d5f91669e HTTP/1.1" 200 None 2026-04-19 08:45:56,478 - lava_callback - DEBUG - Processing node 69e495d47ab9251d5f91669e: ltp-dio INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:45:56,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:57,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:57,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e495d47ab9251d5f91669e/log.txt.gz 2026-04-19 08:45:57,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:57,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:57,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e495d47ab9251d5f91669e/lava-logs.yaml 2026-04-19 08:45:57,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:45:57,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:45:57,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e495d47ab9251d5f91669e/lava_callback.json.gz 2026-04-19 08:45:57,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:57,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d47ab9251d5f91669e HTTP/1.1" 200 None 2026-04-19 08:45:57,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:57,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:45:57,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:57,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495d47ab9251d5f91669e HTTP/1.1" 200 None 2026-04-19 08:45:57,668 - lava_callback - INFO - Completed processing callback for node 69e495d47ab9251d5f91669e 2026-04-19 08:45:58,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:45:58,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET /node/698a8e30d9a1cfa777a241f4%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-19 08:46:54,600 - lava_callback - INFO - Received callback for node 69e1f370408ad4de248645dc INFO: 172.21.0.1:60580 - "POST /node/69e1f370408ad4de248645dc HTTP/1.0" 202 Accepted 2026-04-19 08:46:54,608 - lava_callback - INFO - Starting async job submit for node 69e1f370408ad4de248645dc 2026-04-19 08:46:54,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:46:54,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f370408ad4de248645dc HTTP/1.1" 200 None 2026-04-19 08:46:54,640 - lava_callback - DEBUG - Processing node 69e1f370408ad4de248645dc: baseline-arm64-baylibre 2026-04-19 08:46:54,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f370408ad4de248645dc 2026-04-19 08:46:54,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:46:54,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f370408ad4de248645dc HTTP/1.1" 200 None 2026-04-19 08:46:54,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:46:54,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:46:54,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:46:54,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f370408ad4de248645dc HTTP/1.1" 200 None 2026-04-19 08:46:54,706 - lava_callback - ERROR - Error processing callback for node 69e1f370408ad4de248645dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:47:13,034 - lava_callback - INFO - Received callback for node 69e492067ab9251d5f9164af INFO: 172.21.0.1:57236 - "POST /node/69e492067ab9251d5f9164af HTTP/1.0" 202 Accepted 2026-04-19 08:47:13,041 - lava_callback - INFO - Starting async job submit for node 69e492067ab9251d5f9164af 2026-04-19 08:47:13,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:47:13,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e492067ab9251d5f9164af HTTP/1.1" 200 None 2026-04-19 08:47:13,130 - lava_callback - DEBUG - Processing node 69e492067ab9251d5f9164af: ltp-smoke 2026-04-19 08:47:13,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:47:13,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:47:13,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e492067ab9251d5f9164af/log.txt.gz 2026-04-19 08:47:14,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:47:14,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:47:14,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e492067ab9251d5f9164af/lava-logs.yaml 2026-04-19 08:47:14,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:47:14,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:47:14,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e492067ab9251d5f9164af/lava_callback.json.gz 2026-04-19 08:47:14,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:47:14,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e492067ab9251d5f9164af HTTP/1.1" 200 None 2026-04-19 08:47:14,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:47:14,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f4e7ab9251d5f915ea5 HTTP/1.1" 200 None 2026-04-19 08:47:14,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:47:14,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e492067ab9251d5f9164af HTTP/1.1" 200 None 2026-04-19 08:47:14,877 - lava_callback - INFO - Completed processing callback for node 69e492067ab9251d5f9164af INFO: 172.21.0.1:57238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:47:28,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:47:28,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:48:09,091 - lava_callback - INFO - Received callback for node 69e495ce7ab9251d5f91667f INFO: 172.21.0.1:45310 - "POST /node/69e495ce7ab9251d5f91667f HTTP/1.0" 202 Accepted 2026-04-19 08:48:09,097 - lava_callback - INFO - Starting async job submit for node 69e495ce7ab9251d5f91667f 2026-04-19 08:48:09,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:09,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495ce7ab9251d5f91667f HTTP/1.1" 200 None 2026-04-19 08:48:09,137 - lava_callback - DEBUG - Processing node 69e495ce7ab9251d5f91667f: ltp-containers 2026-04-19 08:48:09,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:09,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:09,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e495ce7ab9251d5f91667f/log.txt.gz 2026-04-19 08:48:09,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:09,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:09,938 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e495ce7ab9251d5f91667f/lava-logs.yaml 2026-04-19 08:48:09,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:10,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:10,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e495ce7ab9251d5f91667f/lava_callback.json.gz 2026-04-19 08:48:10,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:10,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495ce7ab9251d5f91667f HTTP/1.1" 200 None 2026-04-19 08:48:10,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:10,118 - lava_callback - INFO - Received callback for node 69e1f3c2408ad4de2486461f 2026-04-19 08:48:10,128 - lava_callback - INFO - Starting async job submit for node 69e1f3c2408ad4de2486461f INFO: 172.21.0.1:32908 - "POST /node/69e1f3c2408ad4de2486461f HTTP/1.0" 202 Accepted 2026-04-19 08:48:10,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:10,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:48:10,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:10,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f3c2408ad4de2486461f HTTP/1.1" 200 None 2026-04-19 08:48:10,150 - lava_callback - DEBUG - Processing node 69e1f3c2408ad4de2486461f: baseline-arm64-clabbe 2026-04-19 08:48:10,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f3c2408ad4de2486461f 2026-04-19 08:48:10,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:10,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f3c2408ad4de2486461f HTTP/1.1" 200 None 2026-04-19 08:48:10,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:10,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495ce7ab9251d5f91667f HTTP/1.1" 200 None 2026-04-19 08:48:10,182 - lava_callback - INFO - Completed processing callback for node 69e495ce7ab9251d5f91667f 2026-04-19 08:48:10,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:48:10,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:10,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f3c2408ad4de2486461f HTTP/1.1" 200 None 2026-04-19 08:48:10,264 - lava_callback - ERROR - Error processing callback for node 69e1f3c2408ad4de2486461f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:48:10,733 - lava_callback - INFO - Received callback for node 69e495d07ab9251d5f916682 INFO: 172.21.0.1:32912 - "POST /node/69e495d07ab9251d5f916682 HTTP/1.0" 202 Accepted 2026-04-19 08:48:10,740 - lava_callback - INFO - Starting async job submit for node 69e495d07ab9251d5f916682 2026-04-19 08:48:10,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:10,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d07ab9251d5f916682 HTTP/1.1" 200 None 2026-04-19 08:48:10,793 - lava_callback - DEBUG - Processing node 69e495d07ab9251d5f916682: ltp-controllers 2026-04-19 08:48:11,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:11,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:11,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e495d07ab9251d5f916682/log.txt.gz 2026-04-19 08:48:11,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:11,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:11,854 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e495d07ab9251d5f916682/lava-logs.yaml 2026-04-19 08:48:11,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:11,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:11,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e495d07ab9251d5f916682/lava_callback.json.gz 2026-04-19 08:48:12,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:12,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d07ab9251d5f916682 HTTP/1.1" 200 None 2026-04-19 08:48:12,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:12,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:48:12,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:12,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495d07ab9251d5f916682 HTTP/1.1" 200 None 2026-04-19 08:48:12,072 - lava_callback - INFO - Completed processing callback for node 69e495d07ab9251d5f916682 INFO: 172.21.0.1:32924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET /node/69865c6b177ca0f097bd4536%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:48:28,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:28,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-19 08:48:29,480 - lava_callback - INFO - Received callback for node 69e495cd7ab9251d5f916673 INFO: 172.21.0.1:36636 - "POST /node/69e495cd7ab9251d5f916673 HTTP/1.0" 202 Accepted 2026-04-19 08:48:29,487 - lava_callback - INFO - Starting async job submit for node 69e495cd7ab9251d5f916673 2026-04-19 08:48:29,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:29,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495cd7ab9251d5f916673 HTTP/1.1" 200 None 2026-04-19 08:48:29,541 - lava_callback - DEBUG - Processing node 69e495cd7ab9251d5f916673: ltp-cap_bounds 2026-04-19 08:48:30,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:30,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:30,084 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e495cd7ab9251d5f916673/log.txt.gz 2026-04-19 08:48:30,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:30,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:30,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e495cd7ab9251d5f916673/lava-logs.yaml 2026-04-19 08:48:30,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:30,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:30,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e495cd7ab9251d5f916673/lava_callback.json.gz 2026-04-19 08:48:30,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:30,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495cd7ab9251d5f916673 HTTP/1.1" 200 None 2026-04-19 08:48:30,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:30,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:48:30,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:30,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495cd7ab9251d5f916673 HTTP/1.1" 200 None 2026-04-19 08:48:30,697 - lava_callback - INFO - Completed processing callback for node 69e495cd7ab9251d5f916673 2026-04-19 08:48:31,165 - lava_callback - INFO - Received callback for node 69e495df7ab9251d5f9166ba INFO: 172.21.0.1:51812 - "POST /node/69e495df7ab9251d5f9166ba HTTP/1.0" 202 Accepted 2026-04-19 08:48:31,172 - lava_callback - INFO - Starting async job submit for node 69e495df7ab9251d5f9166ba 2026-04-19 08:48:31,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:31,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495df7ab9251d5f9166ba HTTP/1.1" 200 None 2026-04-19 08:48:31,215 - lava_callback - DEBUG - Processing node 69e495df7ab9251d5f9166ba: ltp-syscalls 2026-04-19 08:48:32,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:32,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:32,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e495df7ab9251d5f9166ba/log.txt.gz 2026-04-19 08:48:32,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:32,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:32,803 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e495df7ab9251d5f9166ba/lava-logs.yaml 2026-04-19 08:48:32,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:48:32,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:48:32,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e495df7ab9251d5f9166ba/lava_callback.json.gz 2026-04-19 08:48:32,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:32,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495df7ab9251d5f9166ba HTTP/1.1" 200 None 2026-04-19 08:48:32,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:32,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:48:32,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:33,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495df7ab9251d5f9166ba HTTP/1.1" 200 None 2026-04-19 08:48:33,019 - lava_callback - INFO - Completed processing callback for node 69e495df7ab9251d5f9166ba INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:48:58,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:48:58,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:49:30,154 - lava_callback - INFO - Received callback for node 69e1f410408ad4de2486463a INFO: 172.21.0.1:42586 - "POST /node/69e1f410408ad4de2486463a HTTP/1.0" 202 Accepted 2026-04-19 08:49:30,161 - lava_callback - INFO - Starting async job submit for node 69e1f410408ad4de2486463a 2026-04-19 08:49:30,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:30,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f410408ad4de2486463a HTTP/1.1" 200 None 2026-04-19 08:49:30,180 - lava_callback - DEBUG - Processing node 69e1f410408ad4de2486463a: baseline-arm64-clabbe 2026-04-19 08:49:30,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f410408ad4de2486463a 2026-04-19 08:49:30,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:30,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f410408ad4de2486463a HTTP/1.1" 200 None 2026-04-19 08:49:30,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:30,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:49:30,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:30,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f410408ad4de2486463a HTTP/1.1" 200 None 2026-04-19 08:49:30,237 - lava_callback - ERROR - Error processing callback for node 69e1f410408ad4de2486463a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:49:32,680 - lava_callback - INFO - Received callback for node 69e495d27ab9251d5f91669b INFO: 172.21.0.1:42594 - "POST /node/69e495d27ab9251d5f91669b HTTP/1.0" 202 Accepted 2026-04-19 08:49:32,691 - lava_callback - INFO - Starting async job submit for node 69e495d27ab9251d5f91669b 2026-04-19 08:49:32,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:32,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d27ab9251d5f91669b HTTP/1.1" 200 None 2026-04-19 08:49:32,754 - lava_callback - DEBUG - Processing node 69e495d27ab9251d5f91669b: ltp-cve 2026-04-19 08:49:33,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:49:33,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:49:33,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e495d27ab9251d5f91669b/log.txt.gz 2026-04-19 08:49:33,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:49:33,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:49:33,684 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e495d27ab9251d5f91669b/lava-logs.yaml 2026-04-19 08:49:33,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:49:33,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:49:33,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e495d27ab9251d5f91669b/lava_callback.json.gz 2026-04-19 08:49:33,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:33,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d27ab9251d5f91669b HTTP/1.1" 200 None 2026-04-19 08:49:33,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:33,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:49:33,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:33,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495d27ab9251d5f91669b HTTP/1.1" 200 None 2026-04-19 08:49:33,891 - lava_callback - INFO - Completed processing callback for node 69e495d27ab9251d5f91669b INFO: 172.21.0.1:42602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:49:58,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:49:58,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET /node/6985c48771989fb14149807e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:50:50,294 - lava_callback - INFO - Received callback for node 69e1f45e408ad4de24864661 INFO: 172.21.0.1:42506 - "POST /node/69e1f45e408ad4de24864661 HTTP/1.0" 202 Accepted 2026-04-19 08:50:50,300 - lava_callback - INFO - Starting async job submit for node 69e1f45e408ad4de24864661 2026-04-19 08:50:50,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:50:50,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f45e408ad4de24864661 HTTP/1.1" 200 None 2026-04-19 08:50:50,328 - lava_callback - DEBUG - Processing node 69e1f45e408ad4de24864661: baseline-arm64-clabbe 2026-04-19 08:50:50,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f45e408ad4de24864661 2026-04-19 08:50:50,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:50:50,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f45e408ad4de24864661 HTTP/1.1" 200 None 2026-04-19 08:50:50,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:50:50,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:50:50,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:50:50,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f45e408ad4de24864661 HTTP/1.1" 200 None 2026-04-19 08:50:50,400 - lava_callback - ERROR - Error processing callback for node 69e1f45e408ad4de24864661: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:52:09,234 - lava_callback - INFO - Received callback for node 69e495d57ab9251d5f9166a3 INFO: 172.21.0.1:42144 - "POST /node/69e495d57ab9251d5f9166a3 HTTP/1.0" 202 Accepted 2026-04-19 08:52:09,241 - lava_callback - INFO - Starting async job submit for node 69e495d57ab9251d5f9166a3 2026-04-19 08:52:09,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:09,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d57ab9251d5f9166a3 HTTP/1.1" 200 None 2026-04-19 08:52:09,280 - lava_callback - DEBUG - Processing node 69e495d57ab9251d5f9166a3: ltp-fs_bind 2026-04-19 08:52:09,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:09,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:09,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e495d57ab9251d5f9166a3/log.txt.gz 2026-04-19 08:52:09,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:10,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:10,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e495d57ab9251d5f9166a3/lava-logs.yaml 2026-04-19 08:52:10,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:10,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:10,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e495d57ab9251d5f9166a3/lava_callback.json.gz 2026-04-19 08:52:10,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:10,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d57ab9251d5f9166a3 HTTP/1.1" 200 None 2026-04-19 08:52:10,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:10,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:52:10,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:10,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495d57ab9251d5f9166a3 HTTP/1.1" 200 None 2026-04-19 08:52:10,400 - lava_callback - INFO - Completed processing callback for node 69e495d57ab9251d5f9166a3 2026-04-19 08:52:10,881 - lava_callback - INFO - Received callback for node 69e495d77ab9251d5f9166a7 INFO: 172.21.0.1:44806 - "POST /node/69e495d77ab9251d5f9166a7 HTTP/1.0" 202 Accepted 2026-04-19 08:52:10,890 - lava_callback - INFO - Starting async job submit for node 69e495d77ab9251d5f9166a7 2026-04-19 08:52:10,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:10,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d77ab9251d5f9166a7 HTTP/1.1" 200 None 2026-04-19 08:52:10,932 - lava_callback - DEBUG - Processing node 69e495d77ab9251d5f9166a7: ltp-fsx 2026-04-19 08:52:11,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:11,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:11,380 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e495d77ab9251d5f9166a7/log.txt.gz 2026-04-19 08:52:11,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:11,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:11,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e495d77ab9251d5f9166a7/lava-logs.yaml 2026-04-19 08:52:11,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:11,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:11,856 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e495d77ab9251d5f9166a7/lava_callback.json.gz 2026-04-19 08:52:11,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:11,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d77ab9251d5f9166a7 HTTP/1.1" 200 None 2026-04-19 08:52:11,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:11,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:52:11,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:11,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495d77ab9251d5f9166a7 HTTP/1.1" 200 None 2026-04-19 08:52:11,933 - lava_callback - INFO - Completed processing callback for node 69e495d77ab9251d5f9166a7 INFO: 172.21.0.1:44816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:52:28,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:29,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:52:49,259 - lava_callback - INFO - Received callback for node 69e495d87ab9251d5f9166aa INFO: 172.21.0.1:38928 - "POST /node/69e495d87ab9251d5f9166aa HTTP/1.0" 202 Accepted 2026-04-19 08:52:49,266 - lava_callback - INFO - Starting async job submit for node 69e495d87ab9251d5f9166aa 2026-04-19 08:52:49,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:49,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d87ab9251d5f9166aa HTTP/1.1" 200 None 2026-04-19 08:52:49,314 - lava_callback - DEBUG - Processing node 69e495d87ab9251d5f9166aa: ltp-input 2026-04-19 08:52:49,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:49,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:49,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e495d87ab9251d5f9166aa/log.txt.gz 2026-04-19 08:52:50,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:50,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:50,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e495d87ab9251d5f9166aa/lava-logs.yaml 2026-04-19 08:52:50,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:52:50,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:52:50,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e495d87ab9251d5f9166aa/lava_callback.json.gz 2026-04-19 08:52:50,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:50,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d87ab9251d5f9166aa HTTP/1.1" 200 None 2026-04-19 08:52:50,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:50,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:52:50,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:50,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495d87ab9251d5f9166aa HTTP/1.1" 200 None 2026-04-19 08:52:50,497 - lava_callback - INFO - Completed processing callback for node 69e495d87ab9251d5f9166aa INFO: 172.21.0.1:33712 - "GET /node/69870e9e6e077e4126a7ed11%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:52:59,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:52:59,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:53:20,710 - lava_callback - INFO - Received callback for node 69e497db7ab9251d5f91682e INFO: 172.21.0.1:47240 - "POST /node/69e497db7ab9251d5f91682e HTTP/1.0" 202 Accepted 2026-04-19 08:53:20,717 - lava_callback - INFO - Starting async job submit for node 69e497db7ab9251d5f91682e 2026-04-19 08:53:20,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:20,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497db7ab9251d5f91682e HTTP/1.1" 200 None 2026-04-19 08:53:20,758 - lava_callback - DEBUG - Processing node 69e497db7ab9251d5f91682e: baseline-arm64 2026-04-19 08:53:20,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:21,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:21,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497db7ab9251d5f91682e/log.txt.gz 2026-04-19 08:53:21,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:21,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:21,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497db7ab9251d5f91682e/lava-logs.yaml 2026-04-19 08:53:21,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:21,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:21,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497db7ab9251d5f91682e/lava_callback.json.gz 2026-04-19 08:53:21,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:21,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497db7ab9251d5f91682e HTTP/1.1" 200 None 2026-04-19 08:53:21,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:21,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:53:21,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:21,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497db7ab9251d5f91682e HTTP/1.1" 200 None 2026-04-19 08:53:21,685 - lava_callback - INFO - Completed processing callback for node 69e497db7ab9251d5f91682e INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:53:26,578 - lava_callback - INFO - Received callback for node 69e497f67ab9251d5f9168a0 INFO: 172.21.0.1:47252 - "POST /node/69e497f67ab9251d5f9168a0 HTTP/1.0" 202 Accepted 2026-04-19 08:53:26,586 - lava_callback - INFO - Starting async job submit for node 69e497f67ab9251d5f9168a0 2026-04-19 08:53:26,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:26,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f67ab9251d5f9168a0 HTTP/1.1" 200 None 2026-04-19 08:53:26,602 - lava_callback - DEBUG - Processing node 69e497f67ab9251d5f9168a0: baseline-nfs-arm64 2026-04-19 08:53:26,604 - lava_callback - WARNING - Failed to upload log 2026-04-19 08:53:26,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:26,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:26,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f67ab9251d5f9168a0/lava-logs.yaml 2026-04-19 08:53:26,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:26,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:26,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f67ab9251d5f9168a0/lava_callback.json.gz 2026-04-19 08:53:26,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:26,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f67ab9251d5f9168a0 HTTP/1.1" 200 None 2026-04-19 08:53:26,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:26,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:53:26,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:26,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f67ab9251d5f9168a0 HTTP/1.1" 200 None 2026-04-19 08:53:26,860 - lava_callback - INFO - Completed processing callback for node 69e497f67ab9251d5f9168a0 2026-04-19 08:53:29,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:29,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-19 08:53:31,382 - lava_callback - INFO - Received callback for node 69e497e77ab9251d5f916853 INFO: 172.21.0.1:57148 - "POST /node/69e497e77ab9251d5f916853 HTTP/1.0" 202 Accepted 2026-04-19 08:53:31,390 - lava_callback - INFO - Starting async job submit for node 69e497e77ab9251d5f916853 2026-04-19 08:53:31,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:31,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e77ab9251d5f916853 HTTP/1.1" 200 None 2026-04-19 08:53:31,448 - lava_callback - DEBUG - Processing node 69e497e77ab9251d5f916853: baseline-arm64 2026-04-19 08:53:31,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:31,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:31,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e77ab9251d5f916853/log.txt.gz 2026-04-19 08:53:31,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:32,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:32,031 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e77ab9251d5f916853/lava-logs.yaml 2026-04-19 08:53:32,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:32,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:32,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e77ab9251d5f916853/lava_callback.json.gz 2026-04-19 08:53:32,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:32,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e77ab9251d5f916853 HTTP/1.1" 200 None 2026-04-19 08:53:32,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:32,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:53:32,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:32,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e77ab9251d5f916853 HTTP/1.1" 200 None 2026-04-19 08:53:32,225 - lava_callback - INFO - Completed processing callback for node 69e497e77ab9251d5f916853 2026-04-19 08:53:32,288 - lava_callback - INFO - Received callback for node 69e495d97ab9251d5f9166ad INFO: 172.21.0.1:57152 - "POST /node/69e495d97ab9251d5f9166ad HTTP/1.0" 202 Accepted 2026-04-19 08:53:32,300 - lava_callback - INFO - Starting async job submit for node 69e495d97ab9251d5f9166ad 2026-04-19 08:53:32,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:32,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d97ab9251d5f9166ad HTTP/1.1" 200 None 2026-04-19 08:53:32,364 - lava_callback - DEBUG - Processing node 69e495d97ab9251d5f9166ad: ltp-ipc 2026-04-19 08:53:32,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:33,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:33,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e495d97ab9251d5f9166ad/log.txt.gz 2026-04-19 08:53:33,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:33,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:33,537 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e495d97ab9251d5f9166ad/lava-logs.yaml 2026-04-19 08:53:33,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:33,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:33,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e495d97ab9251d5f9166ad/lava_callback.json.gz 2026-04-19 08:53:33,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:33,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495d97ab9251d5f9166ad HTTP/1.1" 200 None 2026-04-19 08:53:33,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:33,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:53:33,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:33,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495d97ab9251d5f9166ad HTTP/1.1" 200 None 2026-04-19 08:53:33,754 - lava_callback - INFO - Completed processing callback for node 69e495d97ab9251d5f9166ad INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:53:49,246 - lava_callback - INFO - Received callback for node 69e497df7ab9251d5f91683a INFO: 172.21.0.1:51988 - "POST /node/69e497df7ab9251d5f91683a HTTP/1.0" 202 Accepted 2026-04-19 08:53:49,255 - lava_callback - INFO - Starting async job submit for node 69e497df7ab9251d5f91683a 2026-04-19 08:53:49,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:49,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497df7ab9251d5f91683a HTTP/1.1" 200 None 2026-04-19 08:53:49,299 - lava_callback - DEBUG - Processing node 69e497df7ab9251d5f91683a: baseline-arm64 2026-04-19 08:53:49,448 - lava_callback - WARNING - Failed to upload log 2026-04-19 08:53:49,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:49,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:49,656 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497df7ab9251d5f91683a/lava-logs.yaml 2026-04-19 08:53:49,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:53:49,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:53:49,737 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497df7ab9251d5f91683a/lava_callback.json.gz 2026-04-19 08:53:49,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:49,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497df7ab9251d5f91683a HTTP/1.1" 200 None 2026-04-19 08:53:49,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:49,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:53:49,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:49,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497df7ab9251d5f91683a HTTP/1.1" 200 None 2026-04-19 08:53:49,897 - lava_callback - INFO - Completed processing callback for node 69e497df7ab9251d5f91683a INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:53:59,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:53:59,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:54:11,762 - lava_callback - INFO - Received callback for node 69e497e07ab9251d5f91683d INFO: 172.21.0.1:54212 - "POST /node/69e497e07ab9251d5f91683d HTTP/1.0" 202 Accepted 2026-04-19 08:54:11,769 - lava_callback - INFO - Starting async job submit for node 69e497e07ab9251d5f91683d 2026-04-19 08:54:11,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:11,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e07ab9251d5f91683d HTTP/1.1" 200 None 2026-04-19 08:54:11,813 - lava_callback - DEBUG - Processing node 69e497e07ab9251d5f91683d: baseline-arm64 2026-04-19 08:54:11,934 - lava_callback - INFO - Received callback for node 69e497dd7ab9251d5f916834 INFO: 172.21.0.1:54228 - "POST /node/69e497dd7ab9251d5f916834 HTTP/1.0" 202 Accepted 2026-04-19 08:54:11,961 - lava_callback - INFO - Starting async job submit for node 69e497dd7ab9251d5f916834 2026-04-19 08:54:11,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:11,993 - lava_callback - WARNING - Failed to upload log 2026-04-19 08:54:12,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497dd7ab9251d5f916834 HTTP/1.1" 200 None 2026-04-19 08:54:12,061 - lava_callback - DEBUG - Processing node 69e497dd7ab9251d5f916834: baseline-arm64 2026-04-19 08:54:12,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:12,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:12,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e07ab9251d5f91683d/lava-logs.yaml 2026-04-19 08:54:12,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:12,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:12,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:12,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e07ab9251d5f91683d/lava_callback.json.gz 2026-04-19 08:54:12,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:12,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:12,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dd7ab9251d5f916834/log.txt.gz 2026-04-19 08:54:12,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e07ab9251d5f91683d HTTP/1.1" 200 None 2026-04-19 08:54:12,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:12,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:12,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:12,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:12,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e07ab9251d5f91683d HTTP/1.1" 200 None 2026-04-19 08:54:12,938 - lava_callback - INFO - Completed processing callback for node 69e497e07ab9251d5f91683d 2026-04-19 08:54:13,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:13,078 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dd7ab9251d5f916834/lava-logs.yaml 2026-04-19 08:54:13,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:13,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:13,190 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dd7ab9251d5f916834/lava_callback.json.gz 2026-04-19 08:54:13,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:13,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497dd7ab9251d5f916834 HTTP/1.1" 200 None 2026-04-19 08:54:13,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:13,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:13,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:13,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497dd7ab9251d5f916834 HTTP/1.1" 200 None 2026-04-19 08:54:13,273 - lava_callback - INFO - Completed processing callback for node 69e497dd7ab9251d5f916834 INFO: 172.21.0.1:54230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:54:17,390 - lava_callback - INFO - Received callback for node 69e497ea7ab9251d5f91685c INFO: 172.21.0.1:54254 - "POST /node/69e497ea7ab9251d5f91685c HTTP/1.0" 202 Accepted 2026-04-19 08:54:17,396 - lava_callback - INFO - Starting async job submit for node 69e497ea7ab9251d5f91685c 2026-04-19 08:54:17,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:17,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497ea7ab9251d5f91685c HTTP/1.1" 200 None 2026-04-19 08:54:17,432 - lava_callback - DEBUG - Processing node 69e497ea7ab9251d5f91685c: baseline-arm64 2026-04-19 08:54:17,719 - lava_callback - INFO - Received callback for node 69e497e37ab9251d5f91684a INFO: 172.21.0.1:54266 - "POST /node/69e497e37ab9251d5f91684a HTTP/1.0" 202 Accepted 2026-04-19 08:54:17,737 - lava_callback - INFO - Starting async job submit for node 69e497e37ab9251d5f91684a 2026-04-19 08:54:17,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:17,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:17,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e37ab9251d5f91684a HTTP/1.1" 200 None 2026-04-19 08:54:17,828 - lava_callback - DEBUG - Processing node 69e497e37ab9251d5f91684a: baseline-arm64 2026-04-19 08:54:17,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:18,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ea7ab9251d5f91685c/log.txt.gz 2026-04-19 08:54:18,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:18,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:18,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:18,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e37ab9251d5f91684a/log.txt.gz 2026-04-19 08:54:18,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:18,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ea7ab9251d5f91685c/lava-logs.yaml 2026-04-19 08:54:18,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:18,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:19,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:19,047 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ea7ab9251d5f91685c/lava_callback.json.gz 2026-04-19 08:54:19,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:19,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497ea7ab9251d5f91685c HTTP/1.1" 200 None 2026-04-19 08:54:19,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:19,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:19,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:19,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497ea7ab9251d5f91685c HTTP/1.1" 200 None 2026-04-19 08:54:19,144 - lava_callback - INFO - Completed processing callback for node 69e497ea7ab9251d5f91685c 2026-04-19 08:54:19,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:19,163 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e37ab9251d5f91684a/lava-logs.yaml 2026-04-19 08:54:19,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:19,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:19,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e37ab9251d5f91684a/lava_callback.json.gz 2026-04-19 08:54:19,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:19,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e37ab9251d5f91684a HTTP/1.1" 200 None 2026-04-19 08:54:19,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:19,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:19,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:19,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e37ab9251d5f91684a HTTP/1.1" 200 None 2026-04-19 08:54:19,380 - lava_callback - INFO - Completed processing callback for node 69e497e37ab9251d5f91684a 2026-04-19 08:54:20,169 - lava_callback - INFO - Received callback for node 69e497e57ab9251d5f91684d INFO: 172.21.0.1:36110 - "POST /node/69e497e57ab9251d5f91684d HTTP/1.0" 202 Accepted 2026-04-19 08:54:20,175 - lava_callback - INFO - Starting async job submit for node 69e497e57ab9251d5f91684d 2026-04-19 08:54:20,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:20,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e57ab9251d5f91684d HTTP/1.1" 200 None 2026-04-19 08:54:20,212 - lava_callback - DEBUG - Processing node 69e497e57ab9251d5f91684d: baseline-arm64 2026-04-19 08:54:20,404 - lava_callback - INFO - Received callback for node 69e497e87ab9251d5f916856 INFO: 172.21.0.1:36112 - "POST /node/69e497e87ab9251d5f916856 HTTP/1.0" 202 Accepted 2026-04-19 08:54:20,426 - lava_callback - INFO - Starting async job submit for node 69e497e87ab9251d5f916856 2026-04-19 08:54:20,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:20,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e87ab9251d5f916856 HTTP/1.1" 200 None 2026-04-19 08:54:20,584 - lava_callback - DEBUG - Processing node 69e497e87ab9251d5f916856: baseline-arm64 2026-04-19 08:54:20,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:21,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:21,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:21,037 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e57ab9251d5f91684d/log.txt.gz 2026-04-19 08:54:21,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:21,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e87ab9251d5f916856/log.txt.gz 2026-04-19 08:54:21,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:21,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:21,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:21,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e87ab9251d5f916856/lava-logs.yaml 2026-04-19 08:54:21,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:21,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e57ab9251d5f91684d/lava-logs.yaml 2026-04-19 08:54:21,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:21,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:21,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:21,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e87ab9251d5f916856/lava_callback.json.gz 2026-04-19 08:54:21,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:21,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:21,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e57ab9251d5f91684d/lava_callback.json.gz 2026-04-19 08:54:21,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:21,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e87ab9251d5f916856 HTTP/1.1" 200 None 2026-04-19 08:54:21,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e57ab9251d5f91684d HTTP/1.1" 200 None 2026-04-19 08:54:21,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:21,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:21,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:21,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:21,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e87ab9251d5f916856 HTTP/1.1" 200 None 2026-04-19 08:54:21,977 - lava_callback - INFO - Completed processing callback for node 69e497e87ab9251d5f916856 2026-04-19 08:54:22,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e57ab9251d5f91684d HTTP/1.1" 200 None 2026-04-19 08:54:22,084 - lava_callback - INFO - Completed processing callback for node 69e497e57ab9251d5f91684d 2026-04-19 08:54:24,268 - lava_callback - INFO - Received callback for node 69e498367ab9251d5f91697e INFO: 172.21.0.1:36128 - "POST /node/69e498367ab9251d5f91697e HTTP/1.0" 202 Accepted 2026-04-19 08:54:24,274 - lava_callback - INFO - Starting async job submit for node 69e498367ab9251d5f91697e 2026-04-19 08:54:24,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498367ab9251d5f91697e HTTP/1.1" 200 None 2026-04-19 08:54:24,293 - lava_callback - DEBUG - Processing node 69e498367ab9251d5f91697e: baseline-arm 2026-04-19 08:54:24,298 - lava_callback - WARNING - Failed to upload log 2026-04-19 08:54:24,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:24,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:24,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e498367ab9251d5f91697e/lava-logs.yaml 2026-04-19 08:54:24,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:24,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:24,535 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e498367ab9251d5f91697e/lava_callback.json.gz 2026-04-19 08:54:24,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:24,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498367ab9251d5f91697e HTTP/1.1" 200 None 2026-04-19 08:54:24,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:24,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:54:24,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:24,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498367ab9251d5f91697e HTTP/1.1" 200 None 2026-04-19 08:54:24,595 - lava_callback - INFO - Completed processing callback for node 69e498367ab9251d5f91697e INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:54:27,955 - lava_callback - INFO - Received callback for node 69e497dc7ab9251d5f916831 INFO: 172.21.0.1:36146 - "POST /node/69e497dc7ab9251d5f916831 HTTP/1.0" 202 Accepted 2026-04-19 08:54:27,961 - lava_callback - INFO - Starting async job submit for node 69e497dc7ab9251d5f916831 2026-04-19 08:54:27,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:28,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497dc7ab9251d5f916831 HTTP/1.1" 200 None 2026-04-19 08:54:28,002 - lava_callback - DEBUG - Processing node 69e497dc7ab9251d5f916831: baseline-arm64 2026-04-19 08:54:28,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:28,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:28,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dc7ab9251d5f916831/log.txt.gz 2026-04-19 08:54:28,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:28,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:28,759 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dc7ab9251d5f916831/lava-logs.yaml 2026-04-19 08:54:28,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:28,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:28,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dc7ab9251d5f916831/lava_callback.json.gz 2026-04-19 08:54:28,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:28,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497dc7ab9251d5f916831 HTTP/1.1" 200 None 2026-04-19 08:54:28,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:28,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:28,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:28,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497dc7ab9251d5f916831 HTTP/1.1" 200 None 2026-04-19 08:54:28,951 - lava_callback - INFO - Completed processing callback for node 69e497dc7ab9251d5f916831 2026-04-19 08:54:29,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:29,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-19 08:54:34,848 - lava_callback - INFO - Received callback for node 69e497e27ab9251d5f916847 INFO: 172.21.0.1:51104 - "POST /node/69e497e27ab9251d5f916847 HTTP/1.0" 202 Accepted 2026-04-19 08:54:34,858 - lava_callback - INFO - Starting async job submit for node 69e497e27ab9251d5f916847 2026-04-19 08:54:34,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:34,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e27ab9251d5f916847 HTTP/1.1" 200 None 2026-04-19 08:54:34,921 - lava_callback - DEBUG - Processing node 69e497e27ab9251d5f916847: baseline-arm64 2026-04-19 08:54:35,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:35,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:35,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e27ab9251d5f916847/log.txt.gz 2026-04-19 08:54:35,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:35,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:35,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e27ab9251d5f916847/lava-logs.yaml 2026-04-19 08:54:35,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:35,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:35,907 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e27ab9251d5f916847/lava_callback.json.gz 2026-04-19 08:54:35,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:35,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e27ab9251d5f916847 HTTP/1.1" 200 None 2026-04-19 08:54:35,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:35,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:35,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:35,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e27ab9251d5f916847 HTTP/1.1" 200 None 2026-04-19 08:54:35,993 - lava_callback - INFO - Completed processing callback for node 69e497e27ab9251d5f916847 INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:54:37,267 - lava_callback - INFO - Received callback for node 69e497ec7ab9251d5f916869 INFO: 172.21.0.1:51126 - "POST /node/69e497ec7ab9251d5f916869 HTTP/1.0" 202 Accepted 2026-04-19 08:54:37,273 - lava_callback - INFO - Starting async job submit for node 69e497ec7ab9251d5f916869 2026-04-19 08:54:37,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:37,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497ec7ab9251d5f916869 HTTP/1.1" 200 None 2026-04-19 08:54:37,310 - lava_callback - DEBUG - Processing node 69e497ec7ab9251d5f916869: baseline-arm64 2026-04-19 08:54:37,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:37,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:37,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ec7ab9251d5f916869/log.txt.gz 2026-04-19 08:54:37,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:38,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:38,107 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ec7ab9251d5f916869/lava-logs.yaml 2026-04-19 08:54:38,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:38,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:38,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ec7ab9251d5f916869/lava_callback.json.gz 2026-04-19 08:54:38,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:38,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497ec7ab9251d5f916869 HTTP/1.1" 200 None 2026-04-19 08:54:38,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:38,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:38,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:38,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497ec7ab9251d5f916869 HTTP/1.1" 200 None 2026-04-19 08:54:38,425 - lava_callback - INFO - Completed processing callback for node 69e497ec7ab9251d5f916869 INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:54:45,878 - lava_callback - INFO - Received callback for node 69e4981f7ab9251d5f91693d INFO: 172.21.0.1:33888 - "POST /node/69e4981f7ab9251d5f91693d HTTP/1.0" 202 Accepted 2026-04-19 08:54:45,887 - lava_callback - INFO - Starting async job submit for node 69e4981f7ab9251d5f91693d 2026-04-19 08:54:45,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:45,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4981f7ab9251d5f91693d HTTP/1.1" 200 None 2026-04-19 08:54:45,934 - lava_callback - DEBUG - Processing node 69e4981f7ab9251d5f91693d: baseline-arm64-pengutronix 2026-04-19 08:54:46,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:46,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:46,279 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e4981f7ab9251d5f91693d/log.txt.gz 2026-04-19 08:54:46,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:54:46,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:46,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e4981f7ab9251d5f91693d/lava-logs.yaml 2026-04-19 08:54:46,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:46,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:46,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e4981f7ab9251d5f91693d/lava_callback.json.gz 2026-04-19 08:54:46,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:46,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4981f7ab9251d5f91693d HTTP/1.1" 200 None 2026-04-19 08:54:46,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:46,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:46,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:46,809 - lava_callback - INFO - Received callback for node 69e497f47ab9251d5f91689a INFO: 172.21.0.1:33908 - "POST /node/69e497f47ab9251d5f91689a HTTP/1.0" 202 Accepted 2026-04-19 08:54:46,816 - lava_callback - INFO - Starting async job submit for node 69e497f47ab9251d5f91689a 2026-04-19 08:54:46,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:46,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4981f7ab9251d5f91693d HTTP/1.1" 200 None 2026-04-19 08:54:46,877 - lava_callback - INFO - Completed processing callback for node 69e4981f7ab9251d5f91693d 2026-04-19 08:54:46,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f47ab9251d5f91689a HTTP/1.1" 200 None 2026-04-19 08:54:46,885 - lava_callback - DEBUG - Processing node 69e497f47ab9251d5f91689a: baseline-nfs-arm64 2026-04-19 08:54:47,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:47,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:47,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f47ab9251d5f91689a/log.txt.gz 2026-04-19 08:54:47,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:48,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:48,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f47ab9251d5f91689a/lava-logs.yaml 2026-04-19 08:54:48,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:48,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:48,272 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f47ab9251d5f91689a/lava_callback.json.gz 2026-04-19 08:54:48,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:48,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f47ab9251d5f91689a HTTP/1.1" 200 None 2026-04-19 08:54:48,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:48,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:48,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:48,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f47ab9251d5f91689a HTTP/1.1" 200 None 2026-04-19 08:54:48,384 - lava_callback - INFO - Completed processing callback for node 69e497f47ab9251d5f91689a 2026-04-19 08:54:49,235 - lava_callback - INFO - Received callback for node 69e497fb7ab9251d5f9168b0 INFO: 172.21.0.1:33912 - "POST /node/69e497fb7ab9251d5f9168b0 HTTP/1.0" 202 Accepted 2026-04-19 08:54:49,242 - lava_callback - INFO - Starting async job submit for node 69e497fb7ab9251d5f9168b0 2026-04-19 08:54:49,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:49,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497fb7ab9251d5f9168b0 HTTP/1.1" 200 None 2026-04-19 08:54:49,280 - lava_callback - DEBUG - Processing node 69e497fb7ab9251d5f9168b0: baseline-nfs-arm64 2026-04-19 08:54:49,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:49,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:49,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497fb7ab9251d5f9168b0/log.txt.gz 2026-04-19 08:54:49,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:50,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:50,173 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497fb7ab9251d5f9168b0/lava-logs.yaml 2026-04-19 08:54:50,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:50,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:50,326 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497fb7ab9251d5f9168b0/lava_callback.json.gz 2026-04-19 08:54:50,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:50,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497fb7ab9251d5f9168b0 HTTP/1.1" 200 None 2026-04-19 08:54:50,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:50,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:50,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:50,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497fb7ab9251d5f9168b0 HTTP/1.1" 200 None 2026-04-19 08:54:50,436 - lava_callback - INFO - Completed processing callback for node 69e497fb7ab9251d5f9168b0 2026-04-19 08:54:53,213 - lava_callback - INFO - Received callback for node 69e498237ab9251d5f916949 INFO: 172.21.0.1:53300 - "POST /node/69e498237ab9251d5f916949 HTTP/1.0" 202 Accepted 2026-04-19 08:54:53,221 - lava_callback - INFO - Starting async job submit for node 69e498237ab9251d5f916949 2026-04-19 08:54:53,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:53,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498237ab9251d5f916949 HTTP/1.1" 200 None 2026-04-19 08:54:53,265 - lava_callback - DEBUG - Processing node 69e498237ab9251d5f916949: baseline-arm64-foundriesio 2026-04-19 08:54:53,399 - lava_callback - INFO - Received callback for node 69e497dd7ab9251d5f916837 INFO: 172.21.0.1:53310 - "POST /node/69e497dd7ab9251d5f916837 HTTP/1.0" 202 Accepted 2026-04-19 08:54:53,411 - lava_callback - INFO - Starting async job submit for node 69e497dd7ab9251d5f916837 2026-04-19 08:54:53,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:53,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497dd7ab9251d5f916837 HTTP/1.1" 200 None 2026-04-19 08:54:53,599 - lava_callback - DEBUG - Processing node 69e497dd7ab9251d5f916837: baseline-arm64 2026-04-19 08:54:53,857 - lava_callback - INFO - Received callback for node 69e498207ab9251d5f916940 2026-04-19 08:54:53,878 - lava_callback - INFO - Starting async job submit for node 69e498207ab9251d5f916940 INFO: 172.21.0.1:53322 - "POST /node/69e498207ab9251d5f916940 HTTP/1.0" 202 Accepted 2026-04-19 08:54:53,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:53,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:53,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:54,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:54,058 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e498237ab9251d5f916949/log.txt.gz 2026-04-19 08:54:54,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:54,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:54,438 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e498237ab9251d5f916949/lava-logs.yaml 2026-04-19 08:54:54,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:54,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:54,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e498237ab9251d5f916949/lava_callback.json.gz 2026-04-19 08:54:54,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:54,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498237ab9251d5f916949 HTTP/1.1" 200 None 2026-04-19 08:54:54,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:54,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:54,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:54,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498237ab9251d5f916949 HTTP/1.1" 200 None 2026-04-19 08:54:54,654 - lava_callback - INFO - Completed processing callback for node 69e498237ab9251d5f916949 INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK Upload attempt 1 failed with ConnectionError: HTTPSConnectionPool(host='files-staging.kernelci.org', port=443): Max retries exceeded with url: /upload (Caused by NameResolutionError("HTTPSConnection(host='files-staging.kernelci.org', port=443): Failed to resolve 'files-staging.kernelci.org' ([Errno -2] Name or service not known)")) Retrying in 10 seconds... (4 retries remaining) 2026-04-19 08:54:57,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498207ab9251d5f916940 HTTP/1.1" 200 None 2026-04-19 08:54:57,986 - lava_callback - DEBUG - Processing node 69e498207ab9251d5f916940: baseline-arm64-pengutronix 2026-04-19 08:54:58,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:58,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:58,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e498207ab9251d5f916940/log.txt.gz 2026-04-19 08:54:58,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:58,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:58,576 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e498207ab9251d5f916940/lava-logs.yaml 2026-04-19 08:54:58,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:54:58,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:54:58,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e498207ab9251d5f916940/lava_callback.json.gz 2026-04-19 08:54:58,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:58,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498207ab9251d5f916940 HTTP/1.1" 200 None 2026-04-19 08:54:58,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:58,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:54:58,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:58,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498207ab9251d5f916940 HTTP/1.1" 200 None 2026-04-19 08:54:58,779 - lava_callback - INFO - Completed processing callback for node 69e498207ab9251d5f916940 2026-04-19 08:54:59,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:54:59,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-19 08:55:02,034 - lava_callback - INFO - Received callback for node 69e498227ab9251d5f916946 INFO: 172.21.0.1:40090 - "POST /node/69e498227ab9251d5f916946 HTTP/1.0" 202 Accepted 2026-04-19 08:55:02,042 - lava_callback - INFO - Starting async job submit for node 69e498227ab9251d5f916946 2026-04-19 08:55:02,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:02,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498227ab9251d5f916946 HTTP/1.1" 200 None 2026-04-19 08:55:02,090 - lava_callback - DEBUG - Processing node 69e498227ab9251d5f916946: baseline-arm64-foundriesio 2026-04-19 08:55:02,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:02,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:02,422 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e498227ab9251d5f916946/log.txt.gz 2026-04-19 08:55:02,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:02,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:02,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e498227ab9251d5f916946/lava-logs.yaml 2026-04-19 08:55:02,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:02,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:02,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e498227ab9251d5f916946/lava_callback.json.gz 2026-04-19 08:55:02,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:02,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498227ab9251d5f916946 HTTP/1.1" 200 None 2026-04-19 08:55:02,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:02,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:02,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:02,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498227ab9251d5f916946 HTTP/1.1" 200 None 2026-04-19 08:55:02,950 - lava_callback - INFO - Completed processing callback for node 69e498227ab9251d5f916946 2026-04-19 08:55:06,513 - lava_callback - INFO - Received callback for node 69e498217ab9251d5f916943 INFO: 172.21.0.1:40098 - "POST /node/69e498217ab9251d5f916943 HTTP/1.0" 202 Accepted 2026-04-19 08:55:06,520 - lava_callback - INFO - Starting async job submit for node 69e498217ab9251d5f916943 INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:55:06,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:06,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498217ab9251d5f916943 HTTP/1.1" 200 None 2026-04-19 08:55:06,584 - lava_callback - DEBUG - Processing node 69e498217ab9251d5f916943: baseline-arm64-pengutronix 2026-04-19 08:55:06,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:07,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:07,073 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e498217ab9251d5f916943/log.txt.gz 2026-04-19 08:55:07,274 - lava_callback - INFO - Received callback for node 69e497ef7ab9251d5f91688a 2026-04-19 08:55:07,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40118 - "POST /node/69e497ef7ab9251d5f91688a HTTP/1.0" 202 Accepted 2026-04-19 08:55:07,283 - lava_callback - INFO - Starting async job submit for node 69e497ef7ab9251d5f91688a 2026-04-19 08:55:07,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:07,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497ef7ab9251d5f91688a HTTP/1.1" 200 None 2026-04-19 08:55:07,340 - lava_callback - DEBUG - Processing node 69e497ef7ab9251d5f91688a: baseline-nfs-arm64 2026-04-19 08:55:07,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:07,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e498217ab9251d5f916943/lava-logs.yaml 2026-04-19 08:55:07,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:07,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:07,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e498217ab9251d5f916943/lava_callback.json.gz 2026-04-19 08:55:07,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:07,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:07,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498217ab9251d5f916943 HTTP/1.1" 200 None 2026-04-19 08:55:07,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:08,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:08,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:08,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:08,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498217ab9251d5f916943 HTTP/1.1" 200 None 2026-04-19 08:55:08,090 - lava_callback - INFO - Completed processing callback for node 69e498217ab9251d5f916943 2026-04-19 08:55:08,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:08,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dd7ab9251d5f916837/log.txt.gz 2026-04-19 08:55:08,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:08,193 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497ef7ab9251d5f91688a/log.txt.gz 2026-04-19 08:55:08,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:08,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:08,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:08,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dd7ab9251d5f916837/lava-logs.yaml 2026-04-19 08:55:08,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:08,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:08,910 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497ef7ab9251d5f91688a/lava-logs.yaml 2026-04-19 08:55:08,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:08,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:08,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497dd7ab9251d5f916837/lava_callback.json.gz 2026-04-19 08:55:09,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:09,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497dd7ab9251d5f916837 HTTP/1.1" 200 None 2026-04-19 08:55:09,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:09,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:09,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:09,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:09,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497ef7ab9251d5f91688a/lava_callback.json.gz 2026-04-19 08:55:09,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497dd7ab9251d5f916837 HTTP/1.1" 200 None 2026-04-19 08:55:09,088 - lava_callback - INFO - Completed processing callback for node 69e497dd7ab9251d5f916837 2026-04-19 08:55:09,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:09,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497ef7ab9251d5f91688a HTTP/1.1" 200 None 2026-04-19 08:55:09,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:09,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:09,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:09,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497ef7ab9251d5f91688a HTTP/1.1" 200 None 2026-04-19 08:55:09,216 - lava_callback - INFO - Completed processing callback for node 69e497ef7ab9251d5f91688a 2026-04-19 08:55:12,955 - lava_callback - INFO - Received callback for node 69e498087ab9251d5f9168cf INFO: 172.21.0.1:47426 - "POST /node/69e498087ab9251d5f9168cf HTTP/1.0" 202 Accepted 2026-04-19 08:55:12,961 - lava_callback - INFO - Starting async job submit for node 69e498087ab9251d5f9168cf 2026-04-19 08:55:12,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:13,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498087ab9251d5f9168cf HTTP/1.1" 200 None 2026-04-19 08:55:13,002 - lava_callback - DEBUG - Processing node 69e498087ab9251d5f9168cf: baseline-arm64-broonie 2026-04-19 08:55:13,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:13,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:13,458 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498087ab9251d5f9168cf/log.txt.gz 2026-04-19 08:55:13,700 - lava_callback - INFO - Received callback for node 69e4981c7ab9251d5f916935 INFO: 172.21.0.1:47436 - "POST /node/69e4981c7ab9251d5f916935 HTTP/1.0" 202 Accepted 2026-04-19 08:55:13,723 - lava_callback - INFO - Starting async job submit for node 69e4981c7ab9251d5f916935 2026-04-19 08:55:13,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:13,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:13,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4981c7ab9251d5f916935 HTTP/1.1" 200 None 2026-04-19 08:55:13,833 - lava_callback - DEBUG - Processing node 69e4981c7ab9251d5f916935: baseline-arm64-kontron 2026-04-19 08:55:14,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:14,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498087ab9251d5f9168cf/lava-logs.yaml 2026-04-19 08:55:14,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:14,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:14,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498087ab9251d5f9168cf/lava_callback.json.gz 2026-04-19 08:55:14,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:14,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:14,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498087ab9251d5f9168cf HTTP/1.1" 200 None 2026-04-19 08:55:14,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:14,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:14,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:14,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498087ab9251d5f9168cf HTTP/1.1" 200 None 2026-04-19 08:55:14,347 - lava_callback - INFO - Completed processing callback for node 69e498087ab9251d5f9168cf 2026-04-19 08:55:14,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:14,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4981c7ab9251d5f916935/log.txt.gz 2026-04-19 08:55:14,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:14,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:14,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4981c7ab9251d5f916935/lava-logs.yaml 2026-04-19 08:55:14,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:14,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:14,994 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4981c7ab9251d5f916935/lava_callback.json.gz 2026-04-19 08:55:15,035 - lava_callback - INFO - Received callback for node 69e4981d7ab9251d5f916939 2026-04-19 08:55:15,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47450 - "POST /node/69e4981d7ab9251d5f916939 HTTP/1.0" 202 Accepted 2026-04-19 08:55:15,046 - lava_callback - INFO - Starting async job submit for node 69e4981d7ab9251d5f916939 2026-04-19 08:55:15,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:15,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4981c7ab9251d5f916935 HTTP/1.1" 200 None 2026-04-19 08:55:15,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:15,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4981d7ab9251d5f916939 HTTP/1.1" 200 None 2026-04-19 08:55:15,104 - lava_callback - DEBUG - Processing node 69e4981d7ab9251d5f916939: baseline-arm64-kontron 2026-04-19 08:55:15,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:15,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47452 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 08:55:15,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4981c7ab9251d5f916935 HTTP/1.1" 200 None 2026-04-19 08:55:15,542 - lava_callback - INFO - Completed processing callback for node 69e4981c7ab9251d5f916935 2026-04-19 08:55:15,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:15,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:15,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4981d7ab9251d5f916939/log.txt.gz 2026-04-19 08:55:16,186 - lava_callback - INFO - Received callback for node 69e497f17ab9251d5f916893 INFO: 172.21.0.1:47464 - "POST /node/69e497f17ab9251d5f916893 HTTP/1.0" 202 Accepted 2026-04-19 08:55:16,208 - lava_callback - INFO - Starting async job submit for node 69e497f17ab9251d5f916893 2026-04-19 08:55:16,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:16,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:16,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f17ab9251d5f916893 HTTP/1.1" 200 None 2026-04-19 08:55:16,278 - lava_callback - DEBUG - Processing node 69e497f17ab9251d5f916893: baseline-nfs-arm64 2026-04-19 08:55:16,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:16,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4981d7ab9251d5f916939/lava-logs.yaml 2026-04-19 08:55:16,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:55:16,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:16,720 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4981d7ab9251d5f916939/lava_callback.json.gz 2026-04-19 08:55:16,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:16,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4981d7ab9251d5f916939 HTTP/1.1" 200 None 2026-04-19 08:55:16,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:16,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:16,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:16,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:17,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4981d7ab9251d5f916939 HTTP/1.1" 200 None 2026-04-19 08:55:17,002 - lava_callback - INFO - Completed processing callback for node 69e4981d7ab9251d5f916939 2026-04-19 08:55:17,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:17,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f17ab9251d5f916893/log.txt.gz 2026-04-19 08:55:17,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:17,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:17,596 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f17ab9251d5f916893/lava-logs.yaml 2026-04-19 08:55:17,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:17,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:17,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f17ab9251d5f916893/lava_callback.json.gz 2026-04-19 08:55:17,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:17,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f17ab9251d5f916893 HTTP/1.1" 200 None 2026-04-19 08:55:17,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:17,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:17,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:17,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f17ab9251d5f916893 HTTP/1.1" 200 None 2026-04-19 08:55:17,810 - lava_callback - INFO - Completed processing callback for node 69e497f17ab9251d5f916893 2026-04-19 08:55:20,977 - lava_callback - INFO - Received callback for node 69e497f97ab9251d5f9168a9 INFO: 172.21.0.1:33640 - "POST /node/69e497f97ab9251d5f9168a9 HTTP/1.0" 202 Accepted 2026-04-19 08:55:20,984 - lava_callback - INFO - Starting async job submit for node 69e497f97ab9251d5f9168a9 2026-04-19 08:55:21,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:21,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f97ab9251d5f9168a9 HTTP/1.1" 200 None 2026-04-19 08:55:21,024 - lava_callback - DEBUG - Processing node 69e497f97ab9251d5f9168a9: baseline-nfs-arm64 2026-04-19 08:55:21,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:21,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:21,772 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f97ab9251d5f9168a9/log.txt.gz 2026-04-19 08:55:22,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:22,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:22,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f97ab9251d5f9168a9/lava-logs.yaml 2026-04-19 08:55:22,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:22,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:22,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f97ab9251d5f9168a9/lava_callback.json.gz 2026-04-19 08:55:22,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:22,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f97ab9251d5f9168a9 HTTP/1.1" 200 None 2026-04-19 08:55:22,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:22,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:22,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:22,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f97ab9251d5f9168a9 HTTP/1.1" 200 None 2026-04-19 08:55:22,550 - lava_callback - INFO - Completed processing callback for node 69e497f97ab9251d5f9168a9 INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:55:29,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:29,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-19 08:55:29,202 - lava_callback - INFO - Received callback for node 69e4980b7ab9251d5f9168fe INFO: 172.21.0.1:33664 - "POST /node/69e4980b7ab9251d5f9168fe HTTP/1.0" 202 Accepted 2026-04-19 08:55:29,209 - lava_callback - INFO - Starting async job submit for node 69e4980b7ab9251d5f9168fe 2026-04-19 08:55:29,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:29,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4980b7ab9251d5f9168fe HTTP/1.1" 200 None 2026-04-19 08:55:29,262 - lava_callback - DEBUG - Processing node 69e4980b7ab9251d5f9168fe: baseline-arm64-broonie 2026-04-19 08:55:29,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:29,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:29,856 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980b7ab9251d5f9168fe/log.txt.gz 2026-04-19 08:55:30,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:30,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:30,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980b7ab9251d5f9168fe/lava-logs.yaml 2026-04-19 08:55:30,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:30,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:30,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980b7ab9251d5f9168fe/lava_callback.json.gz 2026-04-19 08:55:30,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:30,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4980b7ab9251d5f9168fe HTTP/1.1" 200 None 2026-04-19 08:55:30,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:30,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:30,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:30,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4980b7ab9251d5f9168fe HTTP/1.1" 200 None 2026-04-19 08:55:30,603 - lava_callback - INFO - Completed processing callback for node 69e4980b7ab9251d5f9168fe 2026-04-19 08:55:32,132 - lava_callback - INFO - Received callback for node 69e4980f7ab9251d5f916910 INFO: 172.21.0.1:37872 - "POST /node/69e4980f7ab9251d5f916910 HTTP/1.0" 202 Accepted 2026-04-19 08:55:32,142 - lava_callback - INFO - Starting async job submit for node 69e4980f7ab9251d5f916910 2026-04-19 08:55:32,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:32,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4980f7ab9251d5f916910 HTTP/1.1" 200 None 2026-04-19 08:55:32,191 - lava_callback - DEBUG - Processing node 69e4980f7ab9251d5f916910: baseline-arm64-broonie 2026-04-19 08:55:32,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:32,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:32,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980f7ab9251d5f916910/log.txt.gz 2026-04-19 08:55:32,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:33,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:33,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980f7ab9251d5f916910/lava-logs.yaml 2026-04-19 08:55:33,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:33,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:33,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980f7ab9251d5f916910/lava_callback.json.gz 2026-04-19 08:55:33,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:33,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4980f7ab9251d5f916910 HTTP/1.1" 200 None 2026-04-19 08:55:33,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:33,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:33,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:33,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4980f7ab9251d5f916910 HTTP/1.1" 200 None 2026-04-19 08:55:33,490 - lava_callback - INFO - Completed processing callback for node 69e4980f7ab9251d5f916910 INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:55:49,196 - lava_callback - INFO - Received callback for node 69e4980d7ab9251d5f916905 INFO: 172.21.0.1:36218 - "POST /node/69e4980d7ab9251d5f916905 HTTP/1.0" 202 Accepted 2026-04-19 08:55:49,207 - lava_callback - INFO - Starting async job submit for node 69e4980d7ab9251d5f916905 2026-04-19 08:55:49,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:49,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4980d7ab9251d5f916905 HTTP/1.1" 200 None 2026-04-19 08:55:49,273 - lava_callback - DEBUG - Processing node 69e4980d7ab9251d5f916905: baseline-arm64-broonie 2026-04-19 08:55:49,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:49,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:49,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980d7ab9251d5f916905/log.txt.gz 2026-04-19 08:55:50,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:50,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:50,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980d7ab9251d5f916905/lava-logs.yaml 2026-04-19 08:55:50,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:50,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:50,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980d7ab9251d5f916905/lava_callback.json.gz 2026-04-19 08:55:50,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:50,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4980d7ab9251d5f916905 HTTP/1.1" 200 None 2026-04-19 08:55:50,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:50,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:50,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:50,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4980d7ab9251d5f916905 HTTP/1.1" 200 None 2026-04-19 08:55:50,452 - lava_callback - INFO - Completed processing callback for node 69e4980d7ab9251d5f916905 2026-04-19 08:55:50,581 - lava_callback - INFO - Received callback for node 69e1f584408ad4de248646f9 INFO: 172.21.0.1:34754 - "POST /node/69e1f584408ad4de248646f9 HTTP/1.0" 202 Accepted 2026-04-19 08:55:50,591 - lava_callback - INFO - Starting async job submit for node 69e1f584408ad4de248646f9 2026-04-19 08:55:50,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:50,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f584408ad4de248646f9 HTTP/1.1" 200 None 2026-04-19 08:55:50,625 - lava_callback - DEBUG - Processing node 69e1f584408ad4de248646f9: baseline-arm64-clabbe 2026-04-19 08:55:50,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f584408ad4de248646f9 2026-04-19 08:55:50,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:50,646 - lava_callback - INFO - Received callback for node 69e498137ab9251d5f916916 INFO: 172.21.0.1:34766 - "POST /node/69e498137ab9251d5f916916 HTTP/1.0" 202 Accepted 2026-04-19 08:55:50,678 - lava_callback - INFO - Starting async job submit for node 69e498137ab9251d5f916916 2026-04-19 08:55:50,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f584408ad4de248646f9 HTTP/1.1" 200 None 2026-04-19 08:55:50,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:50,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:50,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:55:50,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:50,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498137ab9251d5f916916 HTTP/1.1" 200 None 2026-04-19 08:55:50,768 - lava_callback - DEBUG - Processing node 69e498137ab9251d5f916916: baseline-arm64-broonie 2026-04-19 08:55:50,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f584408ad4de248646f9 HTTP/1.1" 200 None 2026-04-19 08:55:50,832 - lava_callback - ERROR - Error processing callback for node 69e1f584408ad4de248646f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:55:51,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:51,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:51,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498137ab9251d5f916916/log.txt.gz 2026-04-19 08:55:51,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:51,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:51,774 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498137ab9251d5f916916/lava-logs.yaml 2026-04-19 08:55:51,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:55:51,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:55:51,896 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498137ab9251d5f916916/lava_callback.json.gz 2026-04-19 08:55:51,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:51,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498137ab9251d5f916916 HTTP/1.1" 200 None 2026-04-19 08:55:51,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:51,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:55:51,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:51,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498137ab9251d5f916916 HTTP/1.1" 200 None 2026-04-19 08:55:51,981 - lava_callback - INFO - Completed processing callback for node 69e498137ab9251d5f916916 INFO: 172.21.0.1:34776 - "GET /node/698931b385773790cd34bf79%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:55:59,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:55:59,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:59860 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:56:09,425 - lava_callback - INFO - Received callback for node 69e495db7ab9251d5f9166b0 INFO: 172.21.0.1:59876 - "POST /node/69e495db7ab9251d5f9166b0 HTTP/1.0" 202 Accepted 2026-04-19 08:56:09,432 - lava_callback - INFO - Starting async job submit for node 69e495db7ab9251d5f9166b0 2026-04-19 08:56:09,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:09,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495db7ab9251d5f9166b0 HTTP/1.1" 200 None 2026-04-19 08:56:09,489 - lava_callback - DEBUG - Processing node 69e495db7ab9251d5f9166b0: ltp-pty 2026-04-19 08:56:09,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:09,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:09,927 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e495db7ab9251d5f9166b0/log.txt.gz 2026-04-19 08:56:10,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:10,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:10,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e495db7ab9251d5f9166b0/lava-logs.yaml 2026-04-19 08:56:10,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:10,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:10,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e495db7ab9251d5f9166b0/lava_callback.json.gz 2026-04-19 08:56:10,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:10,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495db7ab9251d5f9166b0 HTTP/1.1" 200 None 2026-04-19 08:56:10,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:10,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:56:10,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:10,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495db7ab9251d5f9166b0 HTTP/1.1" 200 None 2026-04-19 08:56:10,568 - lava_callback - INFO - Completed processing callback for node 69e495db7ab9251d5f9166b0 2026-04-19 08:56:10,971 - lava_callback - INFO - Received callback for node 69e495dc7ab9251d5f9166b3 INFO: 172.21.0.1:53158 - "POST /node/69e495dc7ab9251d5f9166b3 HTTP/1.0" 202 Accepted 2026-04-19 08:56:10,981 - lava_callback - INFO - Starting async job submit for node 69e495dc7ab9251d5f9166b3 2026-04-19 08:56:11,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:11,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495dc7ab9251d5f9166b3 HTTP/1.1" 200 None 2026-04-19 08:56:11,035 - lava_callback - DEBUG - Processing node 69e495dc7ab9251d5f9166b3: ltp-sched 2026-04-19 08:56:11,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:11,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:11,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69e495dc7ab9251d5f9166b3/log.txt.gz 2026-04-19 08:56:11,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:11,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:11,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69e495dc7ab9251d5f9166b3/lava-logs.yaml 2026-04-19 08:56:11,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:11,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:11,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69e495dc7ab9251d5f9166b3/lava_callback.json.gz 2026-04-19 08:56:12,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:12,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495dc7ab9251d5f9166b3 HTTP/1.1" 200 None 2026-04-19 08:56:12,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:12,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:56:12,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:12,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495dc7ab9251d5f9166b3 HTTP/1.1" 200 None 2026-04-19 08:56:12,065 - lava_callback - INFO - Completed processing callback for node 69e495dc7ab9251d5f9166b3 2026-04-19 08:56:12,384 - lava_callback - INFO - Received callback for node 69e498117ab9251d5f916913 INFO: 172.21.0.1:53164 - "POST /node/69e498117ab9251d5f916913 HTTP/1.0" 202 Accepted 2026-04-19 08:56:12,391 - lava_callback - INFO - Starting async job submit for node 69e498117ab9251d5f916913 2026-04-19 08:56:12,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:12,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498117ab9251d5f916913 HTTP/1.1" 200 None 2026-04-19 08:56:12,429 - lava_callback - DEBUG - Processing node 69e498117ab9251d5f916913: baseline-arm64-broonie 2026-04-19 08:56:12,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:12,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:12,811 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498117ab9251d5f916913/log.txt.gz 2026-04-19 08:56:13,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:13,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:13,166 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498117ab9251d5f916913/lava-logs.yaml 2026-04-19 08:56:13,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:13,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:13,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498117ab9251d5f916913/lava_callback.json.gz 2026-04-19 08:56:13,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:13,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498117ab9251d5f916913 HTTP/1.1" 200 None 2026-04-19 08:56:13,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:13,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:56:13,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:13,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498117ab9251d5f916913 HTTP/1.1" 200 None 2026-04-19 08:56:13,368 - lava_callback - INFO - Completed processing callback for node 69e498117ab9251d5f916913 2026-04-19 08:56:13,886 - lava_callback - INFO - Received callback for node 69e498147ab9251d5f916919 INFO: 172.21.0.1:53176 - "POST /node/69e498147ab9251d5f916919 HTTP/1.0" 202 Accepted 2026-04-19 08:56:13,893 - lava_callback - INFO - Starting async job submit for node 69e498147ab9251d5f916919 2026-04-19 08:56:13,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:13,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498147ab9251d5f916919 HTTP/1.1" 200 None 2026-04-19 08:56:13,930 - lava_callback - DEBUG - Processing node 69e498147ab9251d5f916919: baseline-arm64-broonie 2026-04-19 08:56:14,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:14,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:14,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498147ab9251d5f916919/log.txt.gz 2026-04-19 08:56:14,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:14,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:14,644 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498147ab9251d5f916919/lava-logs.yaml 2026-04-19 08:56:14,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:14,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:14,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498147ab9251d5f916919/lava_callback.json.gz 2026-04-19 08:56:14,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:14,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498147ab9251d5f916919 HTTP/1.1" 200 None 2026-04-19 08:56:14,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:14,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:56:14,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:14,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498147ab9251d5f916919 HTTP/1.1" 200 None 2026-04-19 08:56:14,814 - lava_callback - INFO - Completed processing callback for node 69e498147ab9251d5f916919 INFO: 172.21.0.1:53188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET /node/6986fa886e077e4126a7d33c%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-19 08:56:19,906 - lava_callback - INFO - Received callback for node 69e497f77ab9251d5f9168a3 INFO: 172.21.0.1:46946 - "POST /node/69e497f77ab9251d5f9168a3 HTTP/1.0" 202 Accepted 2026-04-19 08:56:19,913 - lava_callback - INFO - Starting async job submit for node 69e497f77ab9251d5f9168a3 2026-04-19 08:56:19,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:19,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f77ab9251d5f9168a3 HTTP/1.1" 200 None 2026-04-19 08:56:19,950 - lava_callback - DEBUG - Processing node 69e497f77ab9251d5f9168a3: baseline-nfs-arm64 2026-04-19 08:56:20,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:20,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:20,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f77ab9251d5f9168a3/log.txt.gz 2026-04-19 08:56:20,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:20,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:20,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f77ab9251d5f9168a3/lava-logs.yaml 2026-04-19 08:56:20,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:56:20,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:56:20,970 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f77ab9251d5f9168a3/lava_callback.json.gz 2026-04-19 08:56:20,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:21,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f77ab9251d5f9168a3 HTTP/1.1" 200 None 2026-04-19 08:56:21,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:21,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:56:21,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:21,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f77ab9251d5f9168a3 HTTP/1.1" 200 None 2026-04-19 08:56:21,064 - lava_callback - INFO - Completed processing callback for node 69e497f77ab9251d5f9168a3 INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:56:29,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:56:29,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:43194 - "GET /node/6992678b98a8bdb31c392022%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:57:09,317 - lava_callback - INFO - Received callback for node 69e495dd7ab9251d5f9166b6 INFO: 172.21.0.1:35788 - "POST /node/69e495dd7ab9251d5f9166b6 HTTP/1.0" 202 Accepted 2026-04-19 08:57:09,323 - lava_callback - INFO - Starting async job submit for node 69e495dd7ab9251d5f9166b6 2026-04-19 08:57:09,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:09,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495dd7ab9251d5f9166b6 HTTP/1.1" 200 None 2026-04-19 08:57:09,363 - lava_callback - DEBUG - Processing node 69e495dd7ab9251d5f9166b6: ltp-smoke 2026-04-19 08:57:09,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:57:09,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:57:09,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e495dd7ab9251d5f9166b6/log.txt.gz 2026-04-19 08:57:10,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:57:10,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:57:10,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e495dd7ab9251d5f9166b6/lava-logs.yaml 2026-04-19 08:57:10,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:57:10,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:57:10,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e495dd7ab9251d5f9166b6/lava_callback.json.gz 2026-04-19 08:57:10,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:10,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495dd7ab9251d5f9166b6 HTTP/1.1" 200 None 2026-04-19 08:57:10,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:10,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:57:10,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:10,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495dd7ab9251d5f9166b6 HTTP/1.1" 200 None 2026-04-19 08:57:10,511 - lava_callback - INFO - Completed processing callback for node 69e495dd7ab9251d5f9166b6 INFO: 172.21.0.1:35938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53328 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:57:29,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:29,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-19 08:57:30,497 - lava_callback - INFO - Received callback for node 69e1f5f7408ad4de24864737 INFO: 172.21.0.1:52852 - "POST /node/69e1f5f7408ad4de24864737 HTTP/1.0" 202 Accepted 2026-04-19 08:57:30,503 - lava_callback - INFO - Starting async job submit for node 69e1f5f7408ad4de24864737 2026-04-19 08:57:30,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:30,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f5f7408ad4de24864737 HTTP/1.1" 200 None 2026-04-19 08:57:30,518 - lava_callback - DEBUG - Processing node 69e1f5f7408ad4de24864737: baseline-arm64-clabbe 2026-04-19 08:57:30,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f5f7408ad4de24864737 2026-04-19 08:57:30,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:30,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f5f7408ad4de24864737 HTTP/1.1" 200 None 2026-04-19 08:57:30,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:30,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:57:30,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:30,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f5f7408ad4de24864737 HTTP/1.1" 200 None 2026-04-19 08:57:30,567 - lava_callback - ERROR - Error processing callback for node 69e1f5f7408ad4de24864737: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:57:32,691 - lava_callback - INFO - Received callback for node 69e495e17ab9251d5f9166bd INFO: 172.21.0.1:52858 - "POST /node/69e495e17ab9251d5f9166bd HTTP/1.0" 202 Accepted 2026-04-19 08:57:32,697 - lava_callback - INFO - Starting async job submit for node 69e495e17ab9251d5f9166bd 2026-04-19 08:57:32,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:32,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495e17ab9251d5f9166bd HTTP/1.1" 200 None 2026-04-19 08:57:32,737 - lava_callback - DEBUG - Processing node 69e495e17ab9251d5f9166bd: ltp-syscalls-ipc 2026-04-19 08:57:33,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:57:33,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:57:33,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e495e17ab9251d5f9166bd/log.txt.gz 2026-04-19 08:57:33,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:57:33,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:57:33,595 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e495e17ab9251d5f9166bd/lava-logs.yaml 2026-04-19 08:57:33,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:57:33,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:57:33,717 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e495e17ab9251d5f9166bd/lava_callback.json.gz 2026-04-19 08:57:33,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:33,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495e17ab9251d5f9166bd HTTP/1.1" 200 None 2026-04-19 08:57:33,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:33,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:57:33,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:33,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495e17ab9251d5f9166bd HTTP/1.1" 200 None 2026-04-19 08:57:33,886 - lava_callback - INFO - Completed processing callback for node 69e495e17ab9251d5f9166bd INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:57:59,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:57:59,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:58:12,152 - lava_callback - INFO - Received callback for node 69e4980e7ab9251d5f91690d INFO: 172.21.0.1:40792 - "POST /node/69e4980e7ab9251d5f91690d HTTP/1.0" 202 Accepted 2026-04-19 08:58:12,162 - lava_callback - INFO - Starting async job submit for node 69e4980e7ab9251d5f91690d 2026-04-19 08:58:12,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:12,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4980e7ab9251d5f91690d HTTP/1.1" 200 None 2026-04-19 08:58:12,208 - lava_callback - DEBUG - Processing node 69e4980e7ab9251d5f91690d: baseline-arm64-broonie 2026-04-19 08:58:12,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:12,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:12,615 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980e7ab9251d5f91690d/log.txt.gz 2026-04-19 08:58:12,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:12,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:12,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980e7ab9251d5f91690d/lava-logs.yaml 2026-04-19 08:58:12,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:13,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:13,063 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4980e7ab9251d5f91690d/lava_callback.json.gz 2026-04-19 08:58:13,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:13,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4980e7ab9251d5f91690d HTTP/1.1" 200 None 2026-04-19 08:58:13,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:13,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:58:13,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:13,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4980e7ab9251d5f91690d HTTP/1.1" 200 None 2026-04-19 08:58:13,156 - lava_callback - INFO - Completed processing callback for node 69e4980e7ab9251d5f91690d INFO: 172.21.0.1:40794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET /node/698e2afb952a14bf500e41b5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:58:29,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:29,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:58:50,613 - lava_callback - INFO - Received callback for node 69e1f645408ad4de24864774 INFO: 172.21.0.1:52808 - "POST /node/69e1f645408ad4de24864774 HTTP/1.0" 202 Accepted 2026-04-19 08:58:50,619 - lava_callback - INFO - Starting async job submit for node 69e1f645408ad4de24864774 2026-04-19 08:58:50,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:50,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f645408ad4de24864774 HTTP/1.1" 200 None 2026-04-19 08:58:50,648 - lava_callback - DEBUG - Processing node 69e1f645408ad4de24864774: baseline-arm64-clabbe 2026-04-19 08:58:50,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f645408ad4de24864774 2026-04-19 08:58:50,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:50,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f645408ad4de24864774 HTTP/1.1" 200 None 2026-04-19 08:58:50,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:50,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 08:58:50,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:50,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f645408ad4de24864774 HTTP/1.1" 200 None 2026-04-19 08:58:50,705 - lava_callback - ERROR - Error processing callback for node 69e1f645408ad4de24864774: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 08:58:53,018 - lava_callback - INFO - Received callback for node 69e498097ab9251d5f9168d6 INFO: 172.21.0.1:52820 - "POST /node/69e498097ab9251d5f9168d6 HTTP/1.0" 202 Accepted 2026-04-19 08:58:53,025 - lava_callback - INFO - Starting async job submit for node 69e498097ab9251d5f9168d6 2026-04-19 08:58:53,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:53,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498097ab9251d5f9168d6 HTTP/1.1" 200 None 2026-04-19 08:58:53,084 - lava_callback - DEBUG - Processing node 69e498097ab9251d5f9168d6: baseline-arm64-broonie 2026-04-19 08:58:53,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:53,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:53,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498097ab9251d5f9168d6/log.txt.gz 2026-04-19 08:58:53,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:53,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:53,664 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498097ab9251d5f9168d6/lava-logs.yaml 2026-04-19 08:58:53,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:53,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:53,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e498097ab9251d5f9168d6/lava_callback.json.gz 2026-04-19 08:58:53,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:53,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e498097ab9251d5f9168d6 HTTP/1.1" 200 None 2026-04-19 08:58:53,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:53,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 08:58:53,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:53,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e498097ab9251d5f9168d6 HTTP/1.1" 200 None 2026-04-19 08:58:53,913 - lava_callback - INFO - Completed processing callback for node 69e498097ab9251d5f9168d6 INFO: 172.21.0.1:52822 - "GET / HTTP/1.0" 200 OK 2026-04-19 08:58:56,580 - lava_callback - INFO - Received callback for node 69e4991b7ab9251d5f916ad0 INFO: 172.21.0.1:52824 - "POST /node/69e4991b7ab9251d5f916ad0 HTTP/1.0" 202 Accepted 2026-04-19 08:58:56,587 - lava_callback - INFO - Starting async job submit for node 69e4991b7ab9251d5f916ad0 2026-04-19 08:58:56,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:56,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4991b7ab9251d5f916ad0 HTTP/1.1" 200 None 2026-04-19 08:58:56,622 - lava_callback - DEBUG - Processing node 69e4991b7ab9251d5f916ad0: baseline-arm-pengutronix 2026-04-19 08:58:56,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:56,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:56,944 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e4991b7ab9251d5f916ad0/log.txt.gz 2026-04-19 08:58:57,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:57,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:57,213 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e4991b7ab9251d5f916ad0/lava-logs.yaml 2026-04-19 08:58:57,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 08:58:57,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 08:58:57,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e4991b7ab9251d5f916ad0/lava_callback.json.gz 2026-04-19 08:58:57,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:57,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4991b7ab9251d5f916ad0 HTTP/1.1" 200 None 2026-04-19 08:58:57,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:57,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 08:58:57,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:57,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4991b7ab9251d5f916ad0 HTTP/1.1" 200 None 2026-04-19 08:58:57,433 - lava_callback - INFO - Completed processing callback for node 69e4991b7ab9251d5f916ad0 2026-04-19 08:58:59,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 08:58:59,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:00:09,512 - lava_callback - INFO - Received callback for node 69e495e27ab9251d5f9166c0 INFO: 172.21.0.1:46124 - "POST /node/69e495e27ab9251d5f9166c0 HTTP/1.0" 202 Accepted 2026-04-19 09:00:09,522 - lava_callback - INFO - Starting async job submit for node 69e495e27ab9251d5f9166c0 2026-04-19 09:00:09,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:09,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495e27ab9251d5f9166c0 HTTP/1.1" 200 None 2026-04-19 09:00:09,569 - lava_callback - DEBUG - Processing node 69e495e27ab9251d5f9166c0: ltp-timers 2026-04-19 09:00:09,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:10,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:10,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e495e27ab9251d5f9166c0/log.txt.gz 2026-04-19 09:00:10,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:10,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:10,485 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e495e27ab9251d5f9166c0/lava-logs.yaml 2026-04-19 09:00:10,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:10,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:10,605 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e495e27ab9251d5f9166c0/lava_callback.json.gz 2026-04-19 09:00:10,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:10,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495e27ab9251d5f9166c0 HTTP/1.1" 200 None 2026-04-19 09:00:10,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:10,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 09:00:10,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:10,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495e27ab9251d5f9166c0 HTTP/1.1" 200 None 2026-04-19 09:00:10,691 - lava_callback - INFO - Completed processing callback for node 69e495e27ab9251d5f9166c0 2026-04-19 09:00:11,228 - lava_callback - INFO - Received callback for node 69e495e37ab9251d5f9166c3 INFO: 172.21.0.1:56162 - "POST /node/69e495e37ab9251d5f9166c3 HTTP/1.0" 202 Accepted 2026-04-19 09:00:11,235 - lava_callback - INFO - Starting async job submit for node 69e495e37ab9251d5f9166c3 2026-04-19 09:00:11,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:11,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495e37ab9251d5f9166c3 HTTP/1.1" 200 None 2026-04-19 09:00:11,297 - lava_callback - DEBUG - Processing node 69e495e37ab9251d5f9166c3: ltp-watchqueue 2026-04-19 09:00:11,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:11,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:11,730 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e495e37ab9251d5f9166c3/log.txt.gz 2026-04-19 09:00:11,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:12,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:12,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e495e37ab9251d5f9166c3/lava-logs.yaml 2026-04-19 09:00:12,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:12,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:12,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e495e37ab9251d5f9166c3/lava_callback.json.gz 2026-04-19 09:00:12,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:12,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e495e37ab9251d5f9166c3 HTTP/1.1" 200 None 2026-04-19 09:00:12,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:12,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 09:00:12,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:12,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e495e37ab9251d5f9166c3 HTTP/1.1" 200 None 2026-04-19 09:00:12,350 - lava_callback - INFO - Completed processing callback for node 69e495e37ab9251d5f9166c3 INFO: 172.21.0.1:56164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:00:17,937 - lava_callback - INFO - Received callback for node 69e4959a7ab9251d5f9165ce INFO: 172.21.0.1:56182 - "POST /node/69e4959a7ab9251d5f9165ce HTTP/1.0" 202 Accepted 2026-04-19 09:00:17,944 - lava_callback - INFO - Starting async job submit for node 69e4959a7ab9251d5f9165ce 2026-04-19 09:00:17,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:18,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4959a7ab9251d5f9165ce HTTP/1.1" 200 None 2026-04-19 09:00:18,013 - lava_callback - DEBUG - Processing node 69e4959a7ab9251d5f9165ce: baseline-arm 2026-04-19 09:00:18,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:18,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:18,698 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959a7ab9251d5f9165ce/log.txt.gz 2026-04-19 09:00:19,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:19,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:19,265 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959a7ab9251d5f9165ce/lava-logs.yaml 2026-04-19 09:00:19,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:19,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:19,411 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e4959a7ab9251d5f9165ce/lava_callback.json.gz DEBUG: Setup failed for 69e4959a7ab9251d5f9165ce. Transitting job node result: incomplete -> fail 2026-04-19 09:00:19,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:19,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4959a7ab9251d5f9165ce HTTP/1.1" 200 None 2026-04-19 09:00:19,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:19,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 09:00:19,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:19,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4959a7ab9251d5f9165ce HTTP/1.1" 200 None 2026-04-19 09:00:19,716 - lava_callback - INFO - Completed processing callback for node 69e4959a7ab9251d5f9165ce INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:00:29,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:29,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:00:50,651 - lava_callback - INFO - Received callback for node 69e1f6b8408ad4de248647bf INFO: 172.21.0.1:58632 - "POST /node/69e1f6b8408ad4de248647bf HTTP/1.0" 202 Accepted 2026-04-19 09:00:50,657 - lava_callback - INFO - Starting async job submit for node 69e1f6b8408ad4de248647bf 2026-04-19 09:00:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:50,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f6b8408ad4de248647bf HTTP/1.1" 200 None 2026-04-19 09:00:50,689 - lava_callback - DEBUG - Processing node 69e1f6b8408ad4de248647bf: baseline-arm64-clabbe 2026-04-19 09:00:50,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f6b8408ad4de248647bf 2026-04-19 09:00:50,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:50,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f6b8408ad4de248647bf HTTP/1.1" 200 None 2026-04-19 09:00:50,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:50,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:00:50,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:50,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f6b8408ad4de248647bf HTTP/1.1" 200 None 2026-04-19 09:00:50,751 - lava_callback - ERROR - Error processing callback for node 69e1f6b8408ad4de248647bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:00:57,594 - lava_callback - INFO - Received callback for node 69e497ed7ab9251d5f916887 INFO: 172.21.0.1:58644 - "POST /node/69e497ed7ab9251d5f916887 HTTP/1.0" 202 Accepted 2026-04-19 09:00:57,601 - lava_callback - INFO - Starting async job submit for node 69e497ed7ab9251d5f916887 2026-04-19 09:00:57,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:57,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497ed7ab9251d5f916887 HTTP/1.1" 200 None 2026-04-19 09:00:57,657 - lava_callback - DEBUG - Processing node 69e497ed7ab9251d5f916887: baseline-arm64 2026-04-19 09:00:58,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:58,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:58,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ed7ab9251d5f916887/log.txt.gz 2026-04-19 09:00:58,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:58,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:58,490 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ed7ab9251d5f916887/lava-logs.yaml 2026-04-19 09:00:58,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:00:58,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:00:58,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497ed7ab9251d5f916887/lava_callback.json.gz DEBUG: Setup failed for 69e497ed7ab9251d5f916887. Transitting job node result: incomplete -> fail 2026-04-19 09:00:58,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:58,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497ed7ab9251d5f916887 HTTP/1.1" 200 None 2026-04-19 09:00:58,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:58,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:00:58,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:58,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497ed7ab9251d5f916887 HTTP/1.1" 200 None 2026-04-19 09:00:58,809 - lava_callback - INFO - Completed processing callback for node 69e497ed7ab9251d5f916887 2026-04-19 09:00:59,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:00:59,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:01:17,789 - lava_callback - INFO - Received callback for node 69e497f57ab9251d5f91689d INFO: 172.21.0.1:42498 - "POST /node/69e497f57ab9251d5f91689d HTTP/1.0" 202 Accepted 2026-04-19 09:01:17,798 - lava_callback - INFO - Starting async job submit for node 69e497f57ab9251d5f91689d 2026-04-19 09:01:17,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:17,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f57ab9251d5f91689d HTTP/1.1" 200 None 2026-04-19 09:01:17,847 - lava_callback - DEBUG - Processing node 69e497f57ab9251d5f91689d: baseline-nfs-arm64 2026-04-19 09:01:18,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:01:18,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:01:18,982 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f57ab9251d5f91689d/log.txt.gz 2026-04-19 09:01:19,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:01:19,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:01:19,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f57ab9251d5f91689d/lava-logs.yaml 2026-04-19 09:01:19,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:01:19,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:01:19,824 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f57ab9251d5f91689d/lava_callback.json.gz 2026-04-19 09:01:19,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:19,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f57ab9251d5f91689d HTTP/1.1" 200 None 2026-04-19 09:01:19,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:19,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:01:19,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:19,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f57ab9251d5f91689d HTTP/1.1" 200 None 2026-04-19 09:01:19,924 - lava_callback - INFO - Completed processing callback for node 69e497f57ab9251d5f91689d INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:01:29,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:29,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41488 - "GET /node/6990356c985e4efca431c637%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:01:55,471 - lava_callback - INFO - Received callback for node 69e1f6fd408ad4de248647e2 INFO: 172.21.0.1:53560 - "POST /node/69e1f6fd408ad4de248647e2 HTTP/1.0" 202 Accepted 2026-04-19 09:01:55,477 - lava_callback - INFO - Starting async job submit for node 69e1f6fd408ad4de248647e2 2026-04-19 09:01:55,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:55,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f6fd408ad4de248647e2 HTTP/1.1" 200 None 2026-04-19 09:01:55,498 - lava_callback - DEBUG - Processing node 69e1f6fd408ad4de248647e2: baseline-arm64-baylibre 2026-04-19 09:01:55,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f6fd408ad4de248647e2 2026-04-19 09:01:55,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:55,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f6fd408ad4de248647e2 HTTP/1.1" 200 None 2026-04-19 09:01:55,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:55,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:01:55,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:01:55,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f6fd408ad4de248647e2 HTTP/1.1" 200 None 2026-04-19 09:01:55,559 - lava_callback - ERROR - Error processing callback for node 69e1f6fd408ad4de248647e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:03:07,092 - lava_callback - INFO - Received callback for node 69e49a3f7ab9251d5f916b86 INFO: 172.21.0.1:55458 - "POST /node/69e49a3f7ab9251d5f916b86 HTTP/1.0" 202 Accepted 2026-04-19 09:03:07,098 - lava_callback - INFO - Starting async job submit for node 69e49a3f7ab9251d5f916b86 2026-04-19 09:03:07,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:07,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49a3f7ab9251d5f916b86 HTTP/1.1" 200 None 2026-04-19 09:03:07,116 - lava_callback - DEBUG - Processing node 69e49a3f7ab9251d5f916b86: baseline-nfs-arm64 2026-04-19 09:03:07,117 - lava_callback - WARNING - Failed to upload log 2026-04-19 09:03:07,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:03:07,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:03:07,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e49a3f7ab9251d5f916b86/lava-logs.yaml 2026-04-19 09:03:07,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:03:07,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:03:07,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e49a3f7ab9251d5f916b86/lava_callback.json.gz 2026-04-19 09:03:07,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:07,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49a3f7ab9251d5f916b86 HTTP/1.1" 200 None 2026-04-19 09:03:07,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:07,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:03:07,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:07,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49a3f7ab9251d5f916b86 HTTP/1.1" 200 None 2026-04-19 09:03:07,338 - lava_callback - INFO - Completed processing callback for node 69e49a3f7ab9251d5f916b86 INFO: 172.21.0.1:45860 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 09:03:15,508 - lava_callback - INFO - Received callback for node 69e1f74a408ad4de24864809 INFO: 172.21.0.1:45872 - "POST /node/69e1f74a408ad4de24864809 HTTP/1.0" 202 Accepted 2026-04-19 09:03:15,514 - lava_callback - INFO - Starting async job submit for node 69e1f74a408ad4de24864809 2026-04-19 09:03:15,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:15,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f74a408ad4de24864809 HTTP/1.1" 200 None 2026-04-19 09:03:15,529 - lava_callback - DEBUG - Processing node 69e1f74a408ad4de24864809: baseline-arm64-baylibre 2026-04-19 09:03:15,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f74a408ad4de24864809 2026-04-19 09:03:15,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:15,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f74a408ad4de24864809 HTTP/1.1" 200 None 2026-04-19 09:03:15,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:15,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:03:15,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:15,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f74a408ad4de24864809 HTTP/1.1" 200 None 2026-04-19 09:03:15,586 - lava_callback - ERROR - Error processing callback for node 69e1f74a408ad4de24864809: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:03:29,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:29,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET /node/698e229d952a14bf500e3cec%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-19 09:03:52,073 - lava_callback - INFO - Received callback for node 69e497e97ab9251d5f916859 INFO: 172.21.0.1:56772 - "POST /node/69e497e97ab9251d5f916859 HTTP/1.0" 202 Accepted 2026-04-19 09:03:52,080 - lava_callback - INFO - Starting async job submit for node 69e497e97ab9251d5f916859 2026-04-19 09:03:52,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:52,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e97ab9251d5f916859 HTTP/1.1" 200 None 2026-04-19 09:03:52,126 - lava_callback - DEBUG - Processing node 69e497e97ab9251d5f916859: baseline-arm64 2026-04-19 09:03:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:03:52,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:03:52,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e97ab9251d5f916859/log.txt.gz 2026-04-19 09:03:53,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:03:53,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:03:53,436 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e97ab9251d5f916859/lava-logs.yaml 2026-04-19 09:03:53,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:03:53,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:03:53,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e97ab9251d5f916859/lava_callback.json.gz 2026-04-19 09:03:53,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:53,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e97ab9251d5f916859 HTTP/1.1" 200 None 2026-04-19 09:03:53,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:53,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:03:53,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:53,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e97ab9251d5f916859 HTTP/1.1" 200 None 2026-04-19 09:03:53,738 - lava_callback - INFO - Completed processing callback for node 69e497e97ab9251d5f916859 INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:03:59,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:03:59,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:04:35,765 - lava_callback - INFO - Received callback for node 69e1f798408ad4de2486482a INFO: 172.21.0.1:42190 - "POST /node/69e1f798408ad4de2486482a HTTP/1.0" 202 Accepted 2026-04-19 09:04:35,770 - lava_callback - INFO - Starting async job submit for node 69e1f798408ad4de2486482a 2026-04-19 09:04:35,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:04:35,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f798408ad4de2486482a HTTP/1.1" 200 None 2026-04-19 09:04:35,794 - lava_callback - DEBUG - Processing node 69e1f798408ad4de2486482a: baseline-arm64-baylibre 2026-04-19 09:04:35,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f798408ad4de2486482a 2026-04-19 09:04:35,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:04:35,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f798408ad4de2486482a HTTP/1.1" 200 None 2026-04-19 09:04:35,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:04:35,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:04:35,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:04:35,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f798408ad4de2486482a HTTP/1.1" 200 None 2026-04-19 09:04:35,866 - lava_callback - ERROR - Error processing callback for node 69e1f798408ad4de2486482a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /node/69938cf2cebe99dd8e072097%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:05:29,083 - lava_callback - INFO - Received callback for node 69e49aa77ab9251d5f916bc6 INFO: 172.21.0.1:59794 - "POST /node/69e49aa77ab9251d5f916bc6 HTTP/1.0" 202 Accepted 2026-04-19 09:05:29,090 - lava_callback - INFO - Starting async job submit for node 69e49aa77ab9251d5f916bc6 2026-04-19 09:05:29,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:29,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49aa77ab9251d5f916bc6 HTTP/1.1" 200 None 2026-04-19 09:05:29,136 - lava_callback - DEBUG - Processing node 69e49aa77ab9251d5f916bc6: baseline-arm64 2026-04-19 09:05:29,290 - lava_callback - WARNING - Failed to upload log 2026-04-19 09:05:29,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:05:29,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:05:29,484 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49aa77ab9251d5f916bc6/lava-logs.yaml 2026-04-19 09:05:29,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:05:29,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:05:29,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49aa77ab9251d5f916bc6/lava_callback.json.gz 2026-04-19 09:05:29,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:29,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49aa77ab9251d5f916bc6 HTTP/1.1" 200 None 2026-04-19 09:05:29,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:29,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:05:29,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:29,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49aa77ab9251d5f916bc6 HTTP/1.1" 200 None 2026-04-19 09:05:29,741 - lava_callback - INFO - Completed processing callback for node 69e49aa77ab9251d5f916bc6 INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:05:55,625 - lava_callback - INFO - Received callback for node 69e1f7e7408ad4de24864843 INFO: 172.21.0.1:48566 - "POST /node/69e1f7e7408ad4de24864843 HTTP/1.0" 202 Accepted 2026-04-19 09:05:55,631 - lava_callback - INFO - Starting async job submit for node 69e1f7e7408ad4de24864843 2026-04-19 09:05:55,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:55,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f7e7408ad4de24864843 HTTP/1.1" 200 None 2026-04-19 09:05:55,647 - lava_callback - DEBUG - Processing node 69e1f7e7408ad4de24864843: baseline-arm64-baylibre 2026-04-19 09:05:55,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f7e7408ad4de24864843 2026-04-19 09:05:55,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:55,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f7e7408ad4de24864843 HTTP/1.1" 200 None 2026-04-19 09:05:55,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:55,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:05:55,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:55,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f7e7408ad4de24864843 HTTP/1.1" 200 None 2026-04-19 09:05:55,706 - lava_callback - ERROR - Error processing callback for node 69e1f7e7408ad4de24864843: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:05:59,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:05:59,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:06:40,922 - lava_callback - INFO - Received callback for node 69e49af27ab9251d5f916bec INFO: 172.21.0.1:46462 - "POST /node/69e49af27ab9251d5f916bec HTTP/1.0" 202 Accepted 2026-04-19 09:06:40,929 - lava_callback - INFO - Starting async job submit for node 69e49af27ab9251d5f916bec 2026-04-19 09:06:40,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:06:40,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49af27ab9251d5f916bec HTTP/1.1" 200 None 2026-04-19 09:06:40,974 - lava_callback - DEBUG - Processing node 69e49af27ab9251d5f916bec: baseline-arm64 2026-04-19 09:06:41,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:06:41,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:06:41,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49af27ab9251d5f916bec/log.txt.gz 2026-04-19 09:06:41,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:06:41,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:06:41,397 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49af27ab9251d5f916bec/lava-logs.yaml 2026-04-19 09:06:41,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:06:41,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:06:41,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49af27ab9251d5f916bec/lava_callback.json.gz 2026-04-19 09:06:41,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:06:41,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49af27ab9251d5f916bec HTTP/1.1" 200 None 2026-04-19 09:06:41,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:06:41,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:06:41,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:06:41,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49af27ab9251d5f916bec HTTP/1.1" 200 None 2026-04-19 09:06:41,624 - lava_callback - INFO - Completed processing callback for node 69e49af27ab9251d5f916bec INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:06:59,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:06:59,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 09:07:15,722 - lava_callback - INFO - Received callback for node 69e1f834408ad4de24864865 INFO: 172.21.0.1:35078 - "POST /node/69e1f834408ad4de24864865 HTTP/1.0" 202 Accepted 2026-04-19 09:07:15,727 - lava_callback - INFO - Starting async job submit for node 69e1f834408ad4de24864865 2026-04-19 09:07:15,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:07:15,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f834408ad4de24864865 HTTP/1.1" 200 None 2026-04-19 09:07:15,750 - lava_callback - DEBUG - Processing node 69e1f834408ad4de24864865: baseline-arm64-baylibre 2026-04-19 09:07:15,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f834408ad4de24864865 2026-04-19 09:07:15,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:07:15,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f834408ad4de24864865 HTTP/1.1" 200 None 2026-04-19 09:07:15,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:07:15,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:07:15,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:07:15,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f834408ad4de24864865 HTTP/1.1" 200 None 2026-04-19 09:07:15,799 - lava_callback - ERROR - Error processing callback for node 69e1f834408ad4de24864865: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:08:10,790 - lava_callback - INFO - Received callback for node 69e49b407ab9251d5f916c19 INFO: 172.21.0.1:45764 - "POST /node/69e49b407ab9251d5f916c19 HTTP/1.0" 202 Accepted 2026-04-19 09:08:10,797 - lava_callback - INFO - Starting async job submit for node 69e49b407ab9251d5f916c19 2026-04-19 09:08:10,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:10,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49b407ab9251d5f916c19 HTTP/1.1" 200 None 2026-04-19 09:08:10,846 - lava_callback - DEBUG - Processing node 69e49b407ab9251d5f916c19: baseline-arm64 2026-04-19 09:08:11,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:08:11,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:08:11,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49b407ab9251d5f916c19/log.txt.gz 2026-04-19 09:08:11,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:08:11,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:08:11,839 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49b407ab9251d5f916c19/lava-logs.yaml 2026-04-19 09:08:11,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:08:11,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:08:11,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49b407ab9251d5f916c19/lava_callback.json.gz 2026-04-19 09:08:11,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:11,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49b407ab9251d5f916c19 HTTP/1.1" 200 None 2026-04-19 09:08:11,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:11,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:08:11,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:12,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49b407ab9251d5f916c19 HTTP/1.1" 200 None 2026-04-19 09:08:12,015 - lava_callback - INFO - Completed processing callback for node 69e49b407ab9251d5f916c19 INFO: 172.21.0.1:45768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:08:29,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:29,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-19 09:08:35,807 - lava_callback - INFO - Received callback for node 69e1f884408ad4de248648ab INFO: 172.21.0.1:58376 - "POST /node/69e1f884408ad4de248648ab HTTP/1.0" 202 Accepted 2026-04-19 09:08:35,816 - lava_callback - INFO - Starting async job submit for node 69e1f884408ad4de248648ab 2026-04-19 09:08:35,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:35,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f884408ad4de248648ab HTTP/1.1" 200 None 2026-04-19 09:08:35,839 - lava_callback - DEBUG - Processing node 69e1f884408ad4de248648ab: baseline-arm64-baylibre 2026-04-19 09:08:35,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f884408ad4de248648ab 2026-04-19 09:08:35,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:35,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f884408ad4de248648ab HTTP/1.1" 200 None 2026-04-19 09:08:35,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:35,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:08:35,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:35,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f884408ad4de248648ab HTTP/1.1" 200 None 2026-04-19 09:08:35,897 - lava_callback - ERROR - Error processing callback for node 69e1f884408ad4de248648ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:08:44,722 - lava_callback - INFO - Received callback for node 69e49b8a7ab9251d5f916c3e INFO: 172.21.0.1:37632 - "POST /node/69e49b8a7ab9251d5f916c3e HTTP/1.0" 202 Accepted 2026-04-19 09:08:44,728 - lava_callback - INFO - Starting async job submit for node 69e49b8a7ab9251d5f916c3e 2026-04-19 09:08:44,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:44,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49b8a7ab9251d5f916c3e HTTP/1.1" 200 None 2026-04-19 09:08:44,750 - lava_callback - DEBUG - Processing node 69e49b8a7ab9251d5f916c3e: baseline-arm 2026-04-19 09:08:44,755 - lava_callback - WARNING - Failed to upload log 2026-04-19 09:08:44,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:08:44,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:08:44,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e49b8a7ab9251d5f916c3e/lava-logs.yaml 2026-04-19 09:08:44,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:08:44,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:08:44,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e49b8a7ab9251d5f916c3e/lava_callback.json.gz 2026-04-19 09:08:44,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:44,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49b8a7ab9251d5f916c3e HTTP/1.1" 200 None 2026-04-19 09:08:44,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:45,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 09:08:45,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:45,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49b8a7ab9251d5f916c3e HTTP/1.1" 200 None 2026-04-19 09:08:45,048 - lava_callback - INFO - Completed processing callback for node 69e49b8a7ab9251d5f916c3e INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:08:55,776 - lava_callback - INFO - Received callback for node 69e1f8a0408ad4de2486490a INFO: 172.21.0.1:33082 - "POST /node/69e1f8a0408ad4de2486490a HTTP/1.0" 202 Accepted 2026-04-19 09:08:55,782 - lava_callback - INFO - Starting async job submit for node 69e1f8a0408ad4de2486490a 2026-04-19 09:08:55,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:55,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a0408ad4de2486490a HTTP/1.1" 200 None 2026-04-19 09:08:55,809 - lava_callback - DEBUG - Processing node 69e1f8a0408ad4de2486490a: baseline-arm64-baylibre 2026-04-19 09:08:55,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8a0408ad4de2486490a 2026-04-19 09:08:55,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:55,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a0408ad4de2486490a HTTP/1.1" 200 None 2026-04-19 09:08:55,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:55,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:08:55,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:55,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8a0408ad4de2486490a HTTP/1.1" 200 None 2026-04-19 09:08:55,859 - lava_callback - ERROR - Error processing callback for node 69e1f8a0408ad4de2486490a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:08:56,474 - lava_callback - INFO - Received callback for node 69e1f8a1408ad4de2486490d INFO: 172.21.0.1:33090 - "POST /node/69e1f8a1408ad4de2486490d HTTP/1.0" 202 Accepted 2026-04-19 09:08:56,479 - lava_callback - INFO - Starting async job submit for node 69e1f8a1408ad4de2486490d 2026-04-19 09:08:56,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:56,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a1408ad4de2486490d HTTP/1.1" 200 None 2026-04-19 09:08:56,499 - lava_callback - DEBUG - Processing node 69e1f8a1408ad4de2486490d: baseline-arm64-baylibre 2026-04-19 09:08:56,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8a1408ad4de2486490d 2026-04-19 09:08:56,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:56,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a1408ad4de2486490d HTTP/1.1" 200 None 2026-04-19 09:08:56,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:08:56,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:08:56,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:56,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8a1408ad4de2486490d HTTP/1.1" 200 None 2026-04-19 09:08:56,546 - lava_callback - ERROR - Error processing callback for node 69e1f8a1408ad4de2486490d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:08:57,171 - lava_callback - INFO - Received callback for node 69e1f8a3408ad4de24864914 INFO: 172.21.0.1:33104 - "POST /node/69e1f8a3408ad4de24864914 HTTP/1.0" 202 Accepted 2026-04-19 09:08:57,177 - lava_callback - INFO - Starting async job submit for node 69e1f8a3408ad4de24864914 2026-04-19 09:08:57,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:57,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a3408ad4de24864914 HTTP/1.1" 200 None 2026-04-19 09:08:57,192 - lava_callback - DEBUG - Processing node 69e1f8a3408ad4de24864914: baseline-arm64-baylibre 2026-04-19 09:08:57,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8a3408ad4de24864914 2026-04-19 09:08:57,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:57,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a3408ad4de24864914 HTTP/1.1" 200 None 2026-04-19 09:08:57,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:57,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:08:57,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:57,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8a3408ad4de24864914 HTTP/1.1" 200 None 2026-04-19 09:08:57,249 - lava_callback - ERROR - Error processing callback for node 69e1f8a3408ad4de24864914: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:08:57,852 - lava_callback - INFO - Received callback for node 69e1f8a5408ad4de2486491d INFO: 172.21.0.1:33108 - "POST /node/69e1f8a5408ad4de2486491d HTTP/1.0" 202 Accepted 2026-04-19 09:08:57,859 - lava_callback - INFO - Starting async job submit for node 69e1f8a5408ad4de2486491d 2026-04-19 09:08:57,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:57,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a5408ad4de2486491d HTTP/1.1" 200 None 2026-04-19 09:08:57,885 - lava_callback - DEBUG - Processing node 69e1f8a5408ad4de2486491d: baseline-arm64-baylibre 2026-04-19 09:08:57,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8a5408ad4de2486491d 2026-04-19 09:08:57,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:57,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a5408ad4de2486491d HTTP/1.1" 200 None 2026-04-19 09:08:57,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:57,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:08:57,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:57,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8a5408ad4de2486491d HTTP/1.1" 200 None 2026-04-19 09:08:57,932 - lava_callback - ERROR - Error processing callback for node 69e1f8a5408ad4de2486491d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:08:59,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:08:59,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 09:09:15,789 - lava_callback - INFO - Received callback for node 69e1f8a6408ad4de24864947 INFO: 172.21.0.1:51874 - "POST /node/69e1f8a6408ad4de24864947 HTTP/1.0" 202 Accepted 2026-04-19 09:09:15,797 - lava_callback - INFO - Starting async job submit for node 69e1f8a6408ad4de24864947 2026-04-19 09:09:15,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:15,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a6408ad4de24864947 HTTP/1.1" 200 None 2026-04-19 09:09:15,820 - lava_callback - DEBUG - Processing node 69e1f8a6408ad4de24864947: baseline-arm64-baylibre 2026-04-19 09:09:15,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8a6408ad4de24864947 2026-04-19 09:09:15,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:15,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a6408ad4de24864947 HTTP/1.1" 200 None 2026-04-19 09:09:15,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:15,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:15,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:15,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8a6408ad4de24864947 HTTP/1.1" 200 None 2026-04-19 09:09:15,876 - lava_callback - ERROR - Error processing callback for node 69e1f8a6408ad4de24864947: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:09:16,485 - lava_callback - INFO - Received callback for node 69e1f8a8408ad4de2486494a INFO: 172.21.0.1:51882 - "POST /node/69e1f8a8408ad4de2486494a HTTP/1.0" 202 Accepted 2026-04-19 09:09:16,491 - lava_callback - INFO - Starting async job submit for node 69e1f8a8408ad4de2486494a 2026-04-19 09:09:16,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:16,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a8408ad4de2486494a HTTP/1.1" 200 None 2026-04-19 09:09:16,509 - lava_callback - DEBUG - Processing node 69e1f8a8408ad4de2486494a: baseline-arm64-baylibre 2026-04-19 09:09:16,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8a8408ad4de2486494a 2026-04-19 09:09:16,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:09:16,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8a8408ad4de2486494a HTTP/1.1" 200 None 2026-04-19 09:09:16,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:16,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:16,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:16,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8a8408ad4de2486494a HTTP/1.1" 200 None 2026-04-19 09:09:16,570 - lava_callback - ERROR - Error processing callback for node 69e1f8a8408ad4de2486494a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:09:31,120 - lava_callback - INFO - Received callback for node 69e1f8b7408ad4de2486496c INFO: 172.21.0.1:36396 - "POST /node/69e1f8b7408ad4de2486496c HTTP/1.0" 202 Accepted 2026-04-19 09:09:31,125 - lava_callback - INFO - Starting async job submit for node 69e1f8b7408ad4de2486496c 2026-04-19 09:09:31,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:31,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8b7408ad4de2486496c HTTP/1.1" 200 None 2026-04-19 09:09:31,141 - lava_callback - DEBUG - Processing node 69e1f8b7408ad4de2486496c: baseline-arm64-clabbe 2026-04-19 09:09:31,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8b7408ad4de2486496c 2026-04-19 09:09:31,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:31,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8b7408ad4de2486496c HTTP/1.1" 200 None 2026-04-19 09:09:31,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:31,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:31,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:31,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8b7408ad4de2486496c HTTP/1.1" 200 None 2026-04-19 09:09:31,192 - lava_callback - ERROR - Error processing callback for node 69e1f8b7408ad4de2486496c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:09:31,805 - lava_callback - INFO - Received callback for node 69e1f8b8408ad4de2486496f INFO: 172.21.0.1:36402 - "POST /node/69e1f8b8408ad4de2486496f HTTP/1.0" 202 Accepted 2026-04-19 09:09:31,811 - lava_callback - INFO - Starting async job submit for node 69e1f8b8408ad4de2486496f 2026-04-19 09:09:31,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:31,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8b8408ad4de2486496f HTTP/1.1" 200 None 2026-04-19 09:09:31,826 - lava_callback - DEBUG - Processing node 69e1f8b8408ad4de2486496f: baseline-arm64-clabbe 2026-04-19 09:09:31,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8b8408ad4de2486496f 2026-04-19 09:09:31,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:31,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8b8408ad4de2486496f HTTP/1.1" 200 None 2026-04-19 09:09:31,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:31,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:31,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:31,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8b8408ad4de2486496f HTTP/1.1" 200 None 2026-04-19 09:09:31,875 - lava_callback - ERROR - Error processing callback for node 69e1f8b8408ad4de2486496f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:09:32,494 - lava_callback - INFO - Received callback for node 69e1f8b9408ad4de24864972 INFO: 172.21.0.1:36404 - "POST /node/69e1f8b9408ad4de24864972 HTTP/1.0" 202 Accepted 2026-04-19 09:09:32,500 - lava_callback - INFO - Starting async job submit for node 69e1f8b9408ad4de24864972 2026-04-19 09:09:32,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:32,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8b9408ad4de24864972 HTTP/1.1" 200 None 2026-04-19 09:09:32,517 - lava_callback - DEBUG - Processing node 69e1f8b9408ad4de24864972: baseline-arm64-clabbe 2026-04-19 09:09:32,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8b9408ad4de24864972 2026-04-19 09:09:32,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:32,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8b9408ad4de24864972 HTTP/1.1" 200 None 2026-04-19 09:09:32,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:32,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:32,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:32,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8b9408ad4de24864972 HTTP/1.1" 200 None 2026-04-19 09:09:32,588 - lava_callback - ERROR - Error processing callback for node 69e1f8b9408ad4de24864972: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:09:33,185 - lava_callback - INFO - Received callback for node 69e1f8ba408ad4de24864975 INFO: 172.21.0.1:36412 - "POST /node/69e1f8ba408ad4de24864975 HTTP/1.0" 202 Accepted 2026-04-19 09:09:33,191 - lava_callback - INFO - Starting async job submit for node 69e1f8ba408ad4de24864975 2026-04-19 09:09:33,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:33,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8ba408ad4de24864975 HTTP/1.1" 200 None 2026-04-19 09:09:33,206 - lava_callback - DEBUG - Processing node 69e1f8ba408ad4de24864975: baseline-arm64-clabbe 2026-04-19 09:09:33,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8ba408ad4de24864975 2026-04-19 09:09:33,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:33,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8ba408ad4de24864975 HTTP/1.1" 200 None 2026-04-19 09:09:33,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:33,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:33,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:33,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8ba408ad4de24864975 HTTP/1.1" 200 None 2026-04-19 09:09:33,263 - lava_callback - ERROR - Error processing callback for node 69e1f8ba408ad4de24864975: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:09:33,846 - lava_callback - INFO - Received callback for node 69e1f8bb408ad4de24864978 INFO: 172.21.0.1:36422 - "POST /node/69e1f8bb408ad4de24864978 HTTP/1.0" 202 Accepted 2026-04-19 09:09:33,852 - lava_callback - INFO - Starting async job submit for node 69e1f8bb408ad4de24864978 2026-04-19 09:09:33,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:33,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8bb408ad4de24864978 HTTP/1.1" 200 None 2026-04-19 09:09:33,867 - lava_callback - DEBUG - Processing node 69e1f8bb408ad4de24864978: baseline-arm64-clabbe 2026-04-19 09:09:33,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8bb408ad4de24864978 2026-04-19 09:09:33,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:33,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8bb408ad4de24864978 HTTP/1.1" 200 None 2026-04-19 09:09:33,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:33,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:33,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:33,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8bb408ad4de24864978 HTTP/1.1" 200 None 2026-04-19 09:09:33,915 - lava_callback - ERROR - Error processing callback for node 69e1f8bb408ad4de24864978: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:09:34,557 - lava_callback - INFO - Received callback for node 69e1f8bc408ad4de2486497e INFO: 172.21.0.1:36426 - "POST /node/69e1f8bc408ad4de2486497e HTTP/1.0" 202 Accepted 2026-04-19 09:09:34,563 - lava_callback - INFO - Starting async job submit for node 69e1f8bc408ad4de2486497e 2026-04-19 09:09:34,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:34,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8bc408ad4de2486497e HTTP/1.1" 200 None 2026-04-19 09:09:34,591 - lava_callback - DEBUG - Processing node 69e1f8bc408ad4de2486497e: baseline-arm64-clabbe 2026-04-19 09:09:34,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8bc408ad4de2486497e 2026-04-19 09:09:34,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:34,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8bc408ad4de2486497e HTTP/1.1" 200 None 2026-04-19 09:09:34,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:34,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:34,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:34,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8bc408ad4de2486497e HTTP/1.1" 200 None 2026-04-19 09:09:34,663 - lava_callback - ERROR - Error processing callback for node 69e1f8bc408ad4de2486497e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:09:35,254 - lava_callback - INFO - Received callback for node 69e1f8bb408ad4de2486497b INFO: 172.21.0.1:36434 - "POST /node/69e1f8bb408ad4de2486497b HTTP/1.0" 202 Accepted 2026-04-19 09:09:35,261 - lava_callback - INFO - Starting async job submit for node 69e1f8bb408ad4de2486497b 2026-04-19 09:09:35,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:35,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8bb408ad4de2486497b HTTP/1.1" 200 None 2026-04-19 09:09:35,277 - lava_callback - DEBUG - Processing node 69e1f8bb408ad4de2486497b: baseline-arm64-clabbe 2026-04-19 09:09:35,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8bb408ad4de2486497b 2026-04-19 09:09:35,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:35,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8bb408ad4de2486497b HTTP/1.1" 200 None 2026-04-19 09:09:35,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:35,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 09:09:35,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:35,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8bb408ad4de2486497b HTTP/1.1" 200 None 2026-04-19 09:09:35,328 - lava_callback - ERROR - Error processing callback for node 69e1f8bb408ad4de2486497b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:09:51,028 - lava_callback - INFO - Received callback for node 69e1f8d8408ad4de248649c5 INFO: 172.21.0.1:57216 - "POST /node/69e1f8d8408ad4de248649c5 HTTP/1.0" 202 Accepted 2026-04-19 09:09:51,034 - lava_callback - INFO - Starting async job submit for node 69e1f8d8408ad4de248649c5 2026-04-19 09:09:51,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:51,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8d8408ad4de248649c5 HTTP/1.1" 200 None 2026-04-19 09:09:51,049 - lava_callback - DEBUG - Processing node 69e1f8d8408ad4de248649c5: baseline-arm64-clabbe 2026-04-19 09:09:51,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f8d8408ad4de248649c5 2026-04-19 09:09:51,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:51,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f8d8408ad4de248649c5 HTTP/1.1" 200 None 2026-04-19 09:09:51,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:51,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:09:51,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:09:51,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f8d8408ad4de248649c5 HTTP/1.1" 200 None 2026-04-19 09:09:51,099 - lava_callback - ERROR - Error processing callback for node 69e1f8d8408ad4de248649c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:10:23,197 - lava_callback - INFO - Received callback for node 69e49bb47ab9251d5f916c60 INFO: 172.21.0.1:50120 - "POST /node/69e49bb47ab9251d5f916c60 HTTP/1.0" 202 Accepted 2026-04-19 09:10:23,203 - lava_callback - INFO - Starting async job submit for node 69e49bb47ab9251d5f916c60 2026-04-19 09:10:23,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:23,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49bb47ab9251d5f916c60 HTTP/1.1" 200 None 2026-04-19 09:10:23,239 - lava_callback - DEBUG - Processing node 69e49bb47ab9251d5f916c60: baseline-arm64 2026-04-19 09:10:23,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:10:23,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:10:23,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49bb47ab9251d5f916c60/log.txt.gz 2026-04-19 09:10:23,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:10:24,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:10:24,103 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49bb47ab9251d5f916c60/lava-logs.yaml 2026-04-19 09:10:24,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:10:24,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:10:24,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49bb47ab9251d5f916c60/lava_callback.json.gz 2026-04-19 09:10:24,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:24,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49bb47ab9251d5f916c60 HTTP/1.1" 200 None 2026-04-19 09:10:24,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:10:24,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:24,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49bb47ab9251d5f916c60 HTTP/1.1" 200 None 2026-04-19 09:10:24,329 - lava_callback - INFO - Completed processing callback for node 69e49bb47ab9251d5f916c60 INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:10:29,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:10:48,264 - lava_callback - INFO - Received callback for node 69e497e17ab9251d5f916840 INFO: 172.21.0.1:37294 - "POST /node/69e497e17ab9251d5f916840 HTTP/1.0" 202 Accepted 2026-04-19 09:10:48,269 - lava_callback - INFO - Starting async job submit for node 69e497e17ab9251d5f916840 2026-04-19 09:10:48,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:48,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e17ab9251d5f916840 HTTP/1.1" 200 None 2026-04-19 09:10:48,304 - lava_callback - DEBUG - Processing node 69e497e17ab9251d5f916840: baseline-arm64 2026-04-19 09:10:48,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:10:48,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:10:48,578 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e17ab9251d5f916840/log.txt.gz 2026-04-19 09:10:48,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:10:48,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:10:48,815 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e17ab9251d5f916840/lava-logs.yaml 2026-04-19 09:10:48,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:10:48,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:10:48,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e17ab9251d5f916840/lava_callback.json.gz DEBUG: Setup failed for 69e497e17ab9251d5f916840. Transitting job node result: incomplete -> fail 2026-04-19 09:10:48,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:48,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e17ab9251d5f916840 HTTP/1.1" 200 None 2026-04-19 09:10:48,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:49,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:10:49,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:49,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e17ab9251d5f916840 HTTP/1.1" 200 None 2026-04-19 09:10:49,077 - lava_callback - INFO - Completed processing callback for node 69e497e17ab9251d5f916840 INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:10:59,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:10:59,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60440 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:11:11,191 - lava_callback - INFO - Received callback for node 69e1f927408ad4de24864a7c INFO: 172.21.0.1:54004 - "POST /node/69e1f927408ad4de24864a7c HTTP/1.0" 202 Accepted 2026-04-19 09:11:11,197 - lava_callback - INFO - Starting async job submit for node 69e1f927408ad4de24864a7c 2026-04-19 09:11:11,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:11:11,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f927408ad4de24864a7c HTTP/1.1" 200 None 2026-04-19 09:11:11,213 - lava_callback - DEBUG - Processing node 69e1f927408ad4de24864a7c: baseline-arm64-clabbe 2026-04-19 09:11:11,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f927408ad4de24864a7c 2026-04-19 09:11:11,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:11:11,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f927408ad4de24864a7c HTTP/1.1" 200 None 2026-04-19 09:11:11,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:11:11,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:11:11,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:11:11,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f927408ad4de24864a7c HTTP/1.1" 200 None 2026-04-19 09:11:11,267 - lava_callback - ERROR - Error processing callback for node 69e1f927408ad4de24864a7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:12:31,375 - lava_callback - INFO - Received callback for node 69e1f978408ad4de24864adb INFO: 172.21.0.1:51416 - "POST /node/69e1f978408ad4de24864adb HTTP/1.0" 202 Accepted 2026-04-19 09:12:31,381 - lava_callback - INFO - Starting async job submit for node 69e1f978408ad4de24864adb 2026-04-19 09:12:31,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:31,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f978408ad4de24864adb HTTP/1.1" 200 None 2026-04-19 09:12:31,397 - lava_callback - DEBUG - Processing node 69e1f978408ad4de24864adb: baseline-arm64-clabbe 2026-04-19 09:12:31,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f978408ad4de24864adb 2026-04-19 09:12:31,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:31,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f978408ad4de24864adb HTTP/1.1" 200 None 2026-04-19 09:12:31,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:31,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:12:31,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:31,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f978408ad4de24864adb HTTP/1.1" 200 None 2026-04-19 09:12:31,453 - lava_callback - ERROR - Error processing callback for node 69e1f978408ad4de24864adb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:12:54,516 - lava_callback - INFO - Received callback for node 69e49c347ab9251d5f916caf INFO: 172.21.0.1:42174 - "POST /node/69e49c347ab9251d5f916caf HTTP/1.0" 202 Accepted 2026-04-19 09:12:54,523 - lava_callback - INFO - Starting async job submit for node 69e49c347ab9251d5f916caf 2026-04-19 09:12:54,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:54,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49c347ab9251d5f916caf HTTP/1.1" 200 None 2026-04-19 09:12:54,572 - lava_callback - DEBUG - Processing node 69e49c347ab9251d5f916caf: baseline-arm64-kontron 2026-04-19 09:12:54,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:12:54,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:12:54,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e49c347ab9251d5f916caf/log.txt.gz 2026-04-19 09:12:55,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:12:55,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:12:55,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e49c347ab9251d5f916caf/lava-logs.yaml 2026-04-19 09:12:55,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:12:55,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:12:55,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e49c347ab9251d5f916caf/lava_callback.json.gz 2026-04-19 09:12:55,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:55,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49c347ab9251d5f916caf HTTP/1.1" 200 None 2026-04-19 09:12:55,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:55,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:12:55,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:55,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49c347ab9251d5f916caf HTTP/1.1" 200 None 2026-04-19 09:12:55,488 - lava_callback - INFO - Completed processing callback for node 69e49c347ab9251d5f916caf INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:12:59,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:12:59,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-19 09:13:05,640 - lava_callback - INFO - Received callback for node 69e497e67ab9251d5f916850 INFO: 172.21.0.1:51792 - "POST /node/69e497e67ab9251d5f916850 HTTP/1.0" 202 Accepted 2026-04-19 09:13:05,651 - lava_callback - INFO - Starting async job submit for node 69e497e67ab9251d5f916850 2026-04-19 09:13:05,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:05,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e67ab9251d5f916850 HTTP/1.1" 200 None 2026-04-19 09:13:05,733 - lava_callback - DEBUG - Processing node 69e497e67ab9251d5f916850: baseline-arm64 INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:13:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:07,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:07,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e67ab9251d5f916850/log.txt.gz 2026-04-19 09:13:07,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:07,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:07,862 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e67ab9251d5f916850/lava-logs.yaml 2026-04-19 09:13:07,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:08,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:08,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e497e67ab9251d5f916850/lava_callback.json.gz DEBUG: Setup failed for 69e497e67ab9251d5f916850. Transitting job node result: incomplete -> fail 2026-04-19 09:13:08,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:08,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497e67ab9251d5f916850 HTTP/1.1" 200 None 2026-04-19 09:13:08,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:08,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:13:08,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:08,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497e67ab9251d5f916850 HTTP/1.1" 200 None 2026-04-19 09:13:08,313 - lava_callback - INFO - Completed processing callback for node 69e497e67ab9251d5f916850 INFO: 172.21.0.1:42492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:13:19,286 - lava_callback - INFO - Received callback for node 69e497f27ab9251d5f916897 INFO: 172.21.0.1:42512 - "POST /node/69e497f27ab9251d5f916897 HTTP/1.0" 202 Accepted 2026-04-19 09:13:19,294 - lava_callback - INFO - Starting async job submit for node 69e497f27ab9251d5f916897 2026-04-19 09:13:19,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:19,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f27ab9251d5f916897 HTTP/1.1" 200 None 2026-04-19 09:13:19,360 - lava_callback - DEBUG - Processing node 69e497f27ab9251d5f916897: baseline-nfs-arm64 2026-04-19 09:13:20,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:20,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:20,658 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f27ab9251d5f916897/log.txt.gz 2026-04-19 09:13:21,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:21,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:21,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f27ab9251d5f916897/lava-logs.yaml 2026-04-19 09:13:21,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:21,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:21,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f27ab9251d5f916897/lava_callback.json.gz DEBUG: Setup failed for 69e497f27ab9251d5f916897. Transitting job node result: incomplete -> fail 2026-04-19 09:13:21,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:21,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f27ab9251d5f916897 HTTP/1.1" 200 None 2026-04-19 09:13:21,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:21,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:13:21,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:21,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f27ab9251d5f916897 HTTP/1.1" 200 None 2026-04-19 09:13:21,923 - lava_callback - INFO - Completed processing callback for node 69e497f27ab9251d5f916897 INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:13:29,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:29,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:13:48,112 - lava_callback - INFO - Received callback for node 69e497f07ab9251d5f91688d INFO: 172.21.0.1:34330 - "POST /node/69e497f07ab9251d5f91688d HTTP/1.0" 202 Accepted 2026-04-19 09:13:48,118 - lava_callback - INFO - Starting async job submit for node 69e497f07ab9251d5f91688d 2026-04-19 09:13:48,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:48,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f07ab9251d5f91688d HTTP/1.1" 200 None 2026-04-19 09:13:48,156 - lava_callback - DEBUG - Processing node 69e497f07ab9251d5f91688d: baseline-nfs-arm64 2026-04-19 09:13:48,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:48,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:48,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f07ab9251d5f91688d/log.txt.gz 2026-04-19 09:13:48,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:48,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:48,707 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f07ab9251d5f91688d/lava-logs.yaml 2026-04-19 09:13:48,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:13:48,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:13:48,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f07ab9251d5f91688d/lava_callback.json.gz DEBUG: Setup failed for 69e497f07ab9251d5f91688d. Transitting job node result: incomplete -> fail 2026-04-19 09:13:48,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:48,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f07ab9251d5f91688d HTTP/1.1" 200 None 2026-04-19 09:13:48,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:48,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:13:48,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:48,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f07ab9251d5f91688d HTTP/1.1" 200 None 2026-04-19 09:13:48,967 - lava_callback - INFO - Completed processing callback for node 69e497f07ab9251d5f91688d 2026-04-19 09:13:51,234 - lava_callback - INFO - Received callback for node 69e1f9c7408ad4de24864b03 INFO: 172.21.0.1:37346 - "POST /node/69e1f9c7408ad4de24864b03 HTTP/1.0" 202 Accepted 2026-04-19 09:13:51,242 - lava_callback - INFO - Starting async job submit for node 69e1f9c7408ad4de24864b03 2026-04-19 09:13:51,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:51,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f9c7408ad4de24864b03 HTTP/1.1" 200 None 2026-04-19 09:13:51,263 - lava_callback - DEBUG - Processing node 69e1f9c7408ad4de24864b03: baseline-arm64-clabbe 2026-04-19 09:13:51,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1f9c7408ad4de24864b03 2026-04-19 09:13:51,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:51,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1f9c7408ad4de24864b03 HTTP/1.1" 200 None 2026-04-19 09:13:51,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:51,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:13:51,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:51,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1f9c7408ad4de24864b03 HTTP/1.1" 200 None 2026-04-19 09:13:51,323 - lava_callback - ERROR - Error processing callback for node 69e1f9c7408ad4de24864b03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:13:59,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:13:59,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:15:11,291 - lava_callback - INFO - Received callback for node 69e1fa15408ad4de24864b2e INFO: 172.21.0.1:53140 - "POST /node/69e1fa15408ad4de24864b2e HTTP/1.0" 202 Accepted 2026-04-19 09:15:11,296 - lava_callback - INFO - Starting async job submit for node 69e1fa15408ad4de24864b2e 2026-04-19 09:15:11,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:15:11,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fa15408ad4de24864b2e HTTP/1.1" 200 None 2026-04-19 09:15:11,312 - lava_callback - DEBUG - Processing node 69e1fa15408ad4de24864b2e: baseline-arm64-clabbe 2026-04-19 09:15:11,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1fa15408ad4de24864b2e 2026-04-19 09:15:11,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:15:11,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fa15408ad4de24864b2e HTTP/1.1" 200 None 2026-04-19 09:15:11,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:15:11,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:15:11,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:15:11,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1fa15408ad4de24864b2e HTTP/1.1" 200 None 2026-04-19 09:15:11,359 - lava_callback - ERROR - Error processing callback for node 69e1fa15408ad4de24864b2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:16:10,620 - lava_callback - INFO - Received callback for node 69e497f87ab9251d5f9168a6 INFO: 172.21.0.1:36390 - "POST /node/69e497f87ab9251d5f9168a6 HTTP/1.0" 202 Accepted 2026-04-19 09:16:10,629 - lava_callback - INFO - Starting async job submit for node 69e497f87ab9251d5f9168a6 2026-04-19 09:16:10,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:10,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f87ab9251d5f9168a6 HTTP/1.1" 200 None 2026-04-19 09:16:10,672 - lava_callback - DEBUG - Processing node 69e497f87ab9251d5f9168a6: baseline-nfs-arm64 2026-04-19 09:16:11,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:16:11,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:16:11,298 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f87ab9251d5f9168a6/log.txt.gz 2026-04-19 09:16:11,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:16:11,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:16:11,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f87ab9251d5f9168a6/lava-logs.yaml 2026-04-19 09:16:11,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:16:11,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:16:11,869 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e497f87ab9251d5f9168a6/lava_callback.json.gz 2026-04-19 09:16:11,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:11,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e497f87ab9251d5f9168a6 HTTP/1.1" 200 None 2026-04-19 09:16:11,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:11,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:16:11,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:11,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e497f87ab9251d5f9168a6 HTTP/1.1" 200 None 2026-04-19 09:16:12,014 - lava_callback - INFO - Completed processing callback for node 69e497f87ab9251d5f9168a6 2026-04-19 09:16:13,932 - lava_callback - INFO - Received callback for node 69e499347ab9251d5f916ad7 INFO: 172.21.0.1:36400 - "POST /node/69e499347ab9251d5f916ad7 HTTP/1.0" 202 Accepted 2026-04-19 09:16:13,939 - lava_callback - INFO - Starting async job submit for node 69e499347ab9251d5f916ad7 2026-04-19 09:16:14,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:14,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e499347ab9251d5f916ad7 HTTP/1.1" 200 None 2026-04-19 09:16:14,045 - lava_callback - DEBUG - Processing node 69e499347ab9251d5f916ad7: ltp-smoke 2026-04-19 09:16:14,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:16:14,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:16:14,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e499347ab9251d5f916ad7/log.txt.gz 2026-04-19 09:16:14,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:16:15,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:16:15,100 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e499347ab9251d5f916ad7/lava-logs.yaml 2026-04-19 09:16:15,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36414 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 09:16:15,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:16:15,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e499347ab9251d5f916ad7/lava_callback.json.gz 2026-04-19 09:16:15,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:15,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e499347ab9251d5f916ad7 HTTP/1.1" 200 None 2026-04-19 09:16:15,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:15,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f4e7ab9251d5f915ea5 HTTP/1.1" 200 None 2026-04-19 09:16:15,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:15,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e499347ab9251d5f916ad7 HTTP/1.1" 200 None 2026-04-19 09:16:15,598 - lava_callback - INFO - Completed processing callback for node 69e499347ab9251d5f916ad7 INFO: 172.21.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:16:29,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:29,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-19 09:16:31,393 - lava_callback - INFO - Received callback for node 69e1fa64408ad4de24864b4b INFO: 172.21.0.1:39302 - "POST /node/69e1fa64408ad4de24864b4b HTTP/1.0" 202 Accepted 2026-04-19 09:16:31,398 - lava_callback - INFO - Starting async job submit for node 69e1fa64408ad4de24864b4b 2026-04-19 09:16:31,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:31,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fa64408ad4de24864b4b HTTP/1.1" 200 None 2026-04-19 09:16:31,414 - lava_callback - DEBUG - Processing node 69e1fa64408ad4de24864b4b: baseline-arm64-clabbe 2026-04-19 09:16:31,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1fa64408ad4de24864b4b 2026-04-19 09:16:31,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:31,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fa64408ad4de24864b4b HTTP/1.1" 200 None 2026-04-19 09:16:31,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:31,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:16:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:16:31,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1fa64408ad4de24864b4b HTTP/1.1" 200 None 2026-04-19 09:16:31,465 - lava_callback - ERROR - Error processing callback for node 69e1fa64408ad4de24864b4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:17:51,443 - lava_callback - INFO - Received callback for node 69e1fab2408ad4de24864b73 INFO: 172.21.0.1:35910 - "POST /node/69e1fab2408ad4de24864b73 HTTP/1.0" 202 Accepted 2026-04-19 09:17:51,451 - lava_callback - INFO - Starting async job submit for node 69e1fab2408ad4de24864b73 2026-04-19 09:17:51,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:17:51,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fab2408ad4de24864b73 HTTP/1.1" 200 None 2026-04-19 09:17:51,470 - lava_callback - DEBUG - Processing node 69e1fab2408ad4de24864b73: baseline-arm64-clabbe 2026-04-19 09:17:51,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1fab2408ad4de24864b73 2026-04-19 09:17:51,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:17:51,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fab2408ad4de24864b73 HTTP/1.1" 200 None 2026-04-19 09:17:51,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:17:51,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 09:17:51,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:17:51,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1fab2408ad4de24864b73 HTTP/1.1" 200 None 2026-04-19 09:17:51,518 - lava_callback - ERROR - Error processing callback for node 69e1fab2408ad4de24864b73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:20:53,327 - lava_callback - INFO - Received callback for node 69e49d307ab9251d5f916d37 INFO: 172.21.0.1:55258 - "POST /node/69e49d307ab9251d5f916d37 HTTP/1.0" 202 Accepted 2026-04-19 09:20:53,333 - lava_callback - INFO - Starting async job submit for node 69e49d307ab9251d5f916d37 2026-04-19 09:20:53,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:20:53,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49d307ab9251d5f916d37 HTTP/1.1" 200 None 2026-04-19 09:20:53,382 - lava_callback - DEBUG - Processing node 69e49d307ab9251d5f916d37: baseline-arm64-broonie 2026-04-19 09:20:53,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:20:53,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:20:53,690 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e49d307ab9251d5f916d37/log.txt.gz 2026-04-19 09:20:53,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:20:53,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:20:53,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e49d307ab9251d5f916d37/lava-logs.yaml 2026-04-19 09:20:53,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:20:54,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:20:54,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e49d307ab9251d5f916d37/lava_callback.json.gz 2026-04-19 09:20:54,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:20:54,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49d307ab9251d5f916d37 HTTP/1.1" 200 None 2026-04-19 09:20:54,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:20:54,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:20:54,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:20:54,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49d307ab9251d5f916d37 HTTP/1.1" 200 None 2026-04-19 09:20:54,271 - lava_callback - INFO - Completed processing callback for node 69e49d307ab9251d5f916d37 INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:20:59,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:20:59,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:21:52,231 - lava_callback - INFO - Received callback for node 69e49e947ab9251d5f916dea INFO: 172.21.0.1:54274 - "POST /node/69e49e947ab9251d5f916dea HTTP/1.0" 202 Accepted 2026-04-19 09:21:52,237 - lava_callback - INFO - Starting async job submit for node 69e49e947ab9251d5f916dea 2026-04-19 09:21:52,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:21:52,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49e947ab9251d5f916dea HTTP/1.1" 200 None 2026-04-19 09:21:52,270 - lava_callback - DEBUG - Processing node 69e49e947ab9251d5f916dea: baseline-x86 2026-04-19 09:21:52,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:21:52,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:21:52,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e947ab9251d5f916dea/log.txt.gz 2026-04-19 09:21:52,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:21:52,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:21:52,818 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e947ab9251d5f916dea/lava-logs.yaml 2026-04-19 09:21:52,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:21:52,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:21:52,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e947ab9251d5f916dea/lava_callback.json.gz 2026-04-19 09:21:52,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:21:52,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49e947ab9251d5f916dea HTTP/1.1" 200 None 2026-04-19 09:21:52,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:21:52,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f667ab9251d5f915ecc HTTP/1.1" 200 None 2026-04-19 09:21:52,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:21:53,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49e947ab9251d5f916dea HTTP/1.1" 200 None 2026-04-19 09:21:53,004 - lava_callback - INFO - Completed processing callback for node 69e49e947ab9251d5f916dea INFO: 172.21.0.1:54290 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:21:59,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:21:59,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:22:18,809 - lava_callback - INFO - Received callback for node 69e49e967ab9251d5f916df3 INFO: 172.21.0.1:51062 - "POST /node/69e49e967ab9251d5f916df3 HTTP/1.0" 202 Accepted 2026-04-19 09:22:18,815 - lava_callback - INFO - Starting async job submit for node 69e49e967ab9251d5f916df3 2026-04-19 09:22:18,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:22:18,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49e967ab9251d5f916df3 HTTP/1.1" 200 None 2026-04-19 09:22:18,854 - lava_callback - DEBUG - Processing node 69e49e967ab9251d5f916df3: baseline-x86 2026-04-19 09:22:19,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:22:19,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:22:19,144 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e967ab9251d5f916df3/log.txt.gz 2026-04-19 09:22:19,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:22:19,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:22:19,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e967ab9251d5f916df3/lava-logs.yaml 2026-04-19 09:22:19,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:22:19,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:22:19,533 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e967ab9251d5f916df3/lava_callback.json.gz 2026-04-19 09:22:19,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:22:19,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49e967ab9251d5f916df3 HTTP/1.1" 200 None 2026-04-19 09:22:19,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:22:19,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f667ab9251d5f915ecc HTTP/1.1" 200 None 2026-04-19 09:22:19,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:22:19,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49e967ab9251d5f916df3 HTTP/1.1" 200 None 2026-04-19 09:22:19,606 - lava_callback - INFO - Completed processing callback for node 69e49e967ab9251d5f916df3 INFO: 172.21.0.1:52100 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:22:29,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:22:29,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:23:02,376 - lava_callback - INFO - Received callback for node 69e49e957ab9251d5f916ded INFO: 172.21.0.1:47356 - "POST /node/69e49e957ab9251d5f916ded HTTP/1.0" 202 Accepted 2026-04-19 09:23:02,382 - lava_callback - INFO - Starting async job submit for node 69e49e957ab9251d5f916ded 2026-04-19 09:23:02,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:02,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49e957ab9251d5f916ded HTTP/1.1" 200 None 2026-04-19 09:23:02,425 - lava_callback - DEBUG - Processing node 69e49e957ab9251d5f916ded: baseline-x86 2026-04-19 09:23:02,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:23:02,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:23:02,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e957ab9251d5f916ded/log.txt.gz 2026-04-19 09:23:03,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:23:03,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:23:03,188 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e957ab9251d5f916ded/lava-logs.yaml 2026-04-19 09:23:03,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:23:03,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:23:03,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e957ab9251d5f916ded/lava_callback.json.gz 2026-04-19 09:23:03,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:03,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49e957ab9251d5f916ded HTTP/1.1" 200 None 2026-04-19 09:23:03,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:03,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f667ab9251d5f915ecc HTTP/1.1" 200 None 2026-04-19 09:23:03,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:03,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49e957ab9251d5f916ded HTTP/1.1" 200 None 2026-04-19 09:23:03,398 - lava_callback - INFO - Completed processing callback for node 69e49e957ab9251d5f916ded INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:23:07,701 - lava_callback - INFO - Received callback for node 69e49ee97ab9251d5f916e3a INFO: 172.21.0.1:47370 - "POST /node/69e49ee97ab9251d5f916e3a HTTP/1.0" 202 Accepted 2026-04-19 09:23:07,707 - lava_callback - INFO - Starting async job submit for node 69e49ee97ab9251d5f916e3a 2026-04-19 09:23:07,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:07,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49ee97ab9251d5f916e3a HTTP/1.1" 200 None 2026-04-19 09:23:07,728 - lava_callback - DEBUG - Processing node 69e49ee97ab9251d5f916e3a: baseline-nfs-arm64 2026-04-19 09:23:07,729 - lava_callback - WARNING - Failed to upload log 2026-04-19 09:23:07,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:23:07,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:23:07,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e49ee97ab9251d5f916e3a/lava-logs.yaml 2026-04-19 09:23:07,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:23:07,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:23:07,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e49ee97ab9251d5f916e3a/lava_callback.json.gz 2026-04-19 09:23:07,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:07,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49ee97ab9251d5f916e3a HTTP/1.1" 200 None 2026-04-19 09:23:07,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:07,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:23:07,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:07,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49ee97ab9251d5f916e3a HTTP/1.1" 200 None 2026-04-19 09:23:07,943 - lava_callback - INFO - Completed processing callback for node 69e49ee97ab9251d5f916e3a INFO: 172.21.0.1:35872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:23:29,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:23:29,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:26:23,096 - lava_callback - INFO - Received callback for node 69e49dff7ab9251d5f916da3 INFO: 172.21.0.1:59746 - "POST /node/69e49dff7ab9251d5f916da3 HTTP/1.0" 202 Accepted 2026-04-19 09:26:23,103 - lava_callback - INFO - Starting async job submit for node 69e49dff7ab9251d5f916da3 2026-04-19 09:26:23,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:26:23,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49dff7ab9251d5f916da3 HTTP/1.1" 200 None 2026-04-19 09:26:23,154 - lava_callback - DEBUG - Processing node 69e49dff7ab9251d5f916da3: baseline-arm64 2026-04-19 09:26:23,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:26:23,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:26:23,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49dff7ab9251d5f916da3/log.txt.gz 2026-04-19 09:26:23,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:26:24,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:26:24,050 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49dff7ab9251d5f916da3/lava-logs.yaml 2026-04-19 09:26:24,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:26:24,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:26:24,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49dff7ab9251d5f916da3/lava_callback.json.gz DEBUG: Setup failed for 69e49dff7ab9251d5f916da3. Transitting job node result: incomplete -> fail 2026-04-19 09:26:24,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:26:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49dff7ab9251d5f916da3 HTTP/1.1" 200 None 2026-04-19 09:26:24,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:26:24,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:26:24,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:26:24,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49dff7ab9251d5f916da3 HTTP/1.1" 200 None 2026-04-19 09:26:24,430 - lava_callback - INFO - Completed processing callback for node 69e49dff7ab9251d5f916da3 INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:26:29,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:26:29,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:29:20,003 - lava_callback - INFO - Received callback for node 69e4a0357ab9251d5f916ed9 INFO: 172.21.0.1:32886 - "POST /node/69e4a0357ab9251d5f916ed9 HTTP/1.0" 202 Accepted 2026-04-19 09:29:20,010 - lava_callback - INFO - Starting async job submit for node 69e4a0357ab9251d5f916ed9 2026-04-19 09:29:20,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:29:20,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a0357ab9251d5f916ed9 HTTP/1.1" 200 None 2026-04-19 09:29:20,055 - lava_callback - DEBUG - Processing node 69e4a0357ab9251d5f916ed9: baseline-arm64 2026-04-19 09:29:20,189 - lava_callback - WARNING - Failed to upload log 2026-04-19 09:29:20,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:29:20,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:29:20,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a0357ab9251d5f916ed9/lava-logs.yaml 2026-04-19 09:29:20,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:29:20,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:29:20,729 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a0357ab9251d5f916ed9/lava_callback.json.gz 2026-04-19 09:29:20,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:29:20,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a0357ab9251d5f916ed9 HTTP/1.1" 200 None 2026-04-19 09:29:20,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:29:20,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:29:20,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:29:20,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a0357ab9251d5f916ed9 HTTP/1.1" 200 None 2026-04-19 09:29:20,892 - lava_callback - INFO - Completed processing callback for node 69e4a0357ab9251d5f916ed9 INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:29:29,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:29:29,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:31:58,225 - lava_callback - INFO - Received callback for node 69e4a0d17ab9251d5f916f1d INFO: 172.21.0.1:55200 - "POST /node/69e4a0d17ab9251d5f916f1d HTTP/1.0" 202 Accepted 2026-04-19 09:31:58,234 - lava_callback - INFO - Starting async job submit for node 69e4a0d17ab9251d5f916f1d 2026-04-19 09:31:58,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:31:58,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a0d17ab9251d5f916f1d HTTP/1.1" 200 None 2026-04-19 09:31:58,287 - lava_callback - DEBUG - Processing node 69e4a0d17ab9251d5f916f1d: baseline-arm64 2026-04-19 09:31:58,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:31:58,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:31:58,510 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a0d17ab9251d5f916f1d/log.txt.gz 2026-04-19 09:31:58,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:31:58,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:31:58,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a0d17ab9251d5f916f1d/lava-logs.yaml 2026-04-19 09:31:58,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:31:58,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:31:58,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a0d17ab9251d5f916f1d/lava_callback.json.gz 2026-04-19 09:31:58,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:31:58,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a0d17ab9251d5f916f1d HTTP/1.1" 200 None 2026-04-19 09:31:58,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:31:58,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:31:58,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:31:58,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a0d17ab9251d5f916f1d HTTP/1.1" 200 None 2026-04-19 09:31:58,961 - lava_callback - INFO - Completed processing callback for node 69e4a0d17ab9251d5f916f1d 2026-04-19 09:31:59,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:31:59,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:33:30,614 - lava_callback - INFO - Received callback for node 69e49d8d7ab9251d5f916d6f INFO: 172.21.0.1:52672 - "POST /node/69e49d8d7ab9251d5f916d6f HTTP/1.0" 202 Accepted 2026-04-19 09:33:30,620 - lava_callback - INFO - Starting async job submit for node 69e49d8d7ab9251d5f916d6f 2026-04-19 09:33:30,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:33:30,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49d8d7ab9251d5f916d6f HTTP/1.1" 200 None 2026-04-19 09:33:30,689 - lava_callback - DEBUG - Processing node 69e49d8d7ab9251d5f916d6f: baseline-arm 2026-04-19 09:33:31,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:33:31,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:33:31,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e49d8d7ab9251d5f916d6f/log.txt.gz 2026-04-19 09:33:31,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:33:31,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:33:31,928 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e49d8d7ab9251d5f916d6f/lava-logs.yaml 2026-04-19 09:33:31,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:33:32,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:33:32,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e49d8d7ab9251d5f916d6f/lava_callback.json.gz DEBUG: Setup failed for 69e49d8d7ab9251d5f916d6f. Transitting job node result: incomplete -> fail 2026-04-19 09:33:32,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:33:32,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49d8d7ab9251d5f916d6f HTTP/1.1" 200 None 2026-04-19 09:33:32,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:33:32,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 09:33:32,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:33:32,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49d8d7ab9251d5f916d6f HTTP/1.1" 200 None 2026-04-19 09:33:32,361 - lava_callback - INFO - Completed processing callback for node 69e49d8d7ab9251d5f916d6f INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:33:59,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:33:59,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:34:17,330 - lava_callback - INFO - Received callback for node 69e1fe96408ad4de24864d54 INFO: 172.21.0.1:50556 - "POST /node/69e1fe96408ad4de24864d54 HTTP/1.0" 202 Accepted 2026-04-19 09:34:17,335 - lava_callback - INFO - Starting async job submit for node 69e1fe96408ad4de24864d54 2026-04-19 09:34:17,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:17,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fe96408ad4de24864d54 HTTP/1.1" 200 None 2026-04-19 09:34:17,351 - lava_callback - DEBUG - Processing node 69e1fe96408ad4de24864d54: baseline-arm64-baylibre 2026-04-19 09:34:17,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1fe96408ad4de24864d54 2026-04-19 09:34:17,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:17,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fe96408ad4de24864d54 HTTP/1.1" 200 None 2026-04-19 09:34:17,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:17,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:34:17,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:17,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1fe96408ad4de24864d54 HTTP/1.1" 200 None 2026-04-19 09:34:17,412 - lava_callback - ERROR - Error processing callback for node 69e1fe96408ad4de24864d54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:34:54,839 - lava_callback - INFO - Received callback for node 69e4a1b07ab9251d5f916f8d INFO: 172.21.0.1:38894 - "POST /node/69e4a1b07ab9251d5f916f8d HTTP/1.0" 202 Accepted 2026-04-19 09:34:54,845 - lava_callback - INFO - Starting async job submit for node 69e4a1b07ab9251d5f916f8d 2026-04-19 09:34:54,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:54,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a1b07ab9251d5f916f8d HTTP/1.1" 200 None 2026-04-19 09:34:54,887 - lava_callback - DEBUG - Processing node 69e4a1b07ab9251d5f916f8d: baseline-arm 2026-04-19 09:34:54,892 - lava_callback - WARNING - Failed to upload log 2026-04-19 09:34:54,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:34:55,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:34:55,005 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e4a1b07ab9251d5f916f8d/lava-logs.yaml 2026-04-19 09:34:55,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:34:55,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:34:55,125 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e4a1b07ab9251d5f916f8d/lava_callback.json.gz 2026-04-19 09:34:55,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:55,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a1b07ab9251d5f916f8d HTTP/1.1" 200 None 2026-04-19 09:34:55,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:55,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 09:34:55,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:55,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a1b07ab9251d5f916f8d HTTP/1.1" 200 None 2026-04-19 09:34:55,188 - lava_callback - INFO - Completed processing callback for node 69e4a1b07ab9251d5f916f8d INFO: 172.21.0.1:38906 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:34:59,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:34:59,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:35:39,748 - lava_callback - INFO - Received callback for node 69e49f7c7ab9251d5f916e84 INFO: 172.21.0.1:52878 - "POST /node/69e49f7c7ab9251d5f916e84 HTTP/1.0" 202 Accepted 2026-04-19 09:35:39,755 - lava_callback - INFO - Starting async job submit for node 69e49f7c7ab9251d5f916e84 2026-04-19 09:35:39,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:39,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49f7c7ab9251d5f916e84 HTTP/1.1" 200 None 2026-04-19 09:35:39,795 - lava_callback - DEBUG - Processing node 69e49f7c7ab9251d5f916e84: baseline-arm64 2026-04-19 09:35:40,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:35:40,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:35:40,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49f7c7ab9251d5f916e84/log.txt.gz 2026-04-19 09:35:40,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:35:40,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:35:40,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49f7c7ab9251d5f916e84/lava-logs.yaml 2026-04-19 09:35:40,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:35:40,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:35:40,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e49f7c7ab9251d5f916e84/lava_callback.json.gz 2026-04-19 09:35:41,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:41,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49f7c7ab9251d5f916e84 HTTP/1.1" 200 None 2026-04-19 09:35:41,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:41,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:35:41,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:41,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49f7c7ab9251d5f916e84 HTTP/1.1" 200 None 2026-04-19 09:35:41,138 - lava_callback - INFO - Completed processing callback for node 69e49f7c7ab9251d5f916e84 INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:35:57,307 - lava_callback - INFO - Received callback for node 69e1fee8408ad4de24864d81 INFO: 172.21.0.1:53440 - "POST /node/69e1fee8408ad4de24864d81 HTTP/1.0" 202 Accepted 2026-04-19 09:35:57,313 - lava_callback - INFO - Starting async job submit for node 69e1fee8408ad4de24864d81 2026-04-19 09:35:57,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:57,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fee8408ad4de24864d81 HTTP/1.1" 200 None 2026-04-19 09:35:57,341 - lava_callback - DEBUG - Processing node 69e1fee8408ad4de24864d81: baseline-arm64-baylibre 2026-04-19 09:35:57,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1fee8408ad4de24864d81 2026-04-19 09:35:57,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:57,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1fee8408ad4de24864d81 HTTP/1.1" 200 None 2026-04-19 09:35:57,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:57,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:35:57,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:57,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1fee8408ad4de24864d81 HTTP/1.1" 200 None 2026-04-19 09:35:57,388 - lava_callback - ERROR - Error processing callback for node 69e1fee8408ad4de24864d81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-19 09:35:59,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:35:59,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:36:57,335 - lava_callback - INFO - Received callback for node 69e1ff36408ad4de24864da5 INFO: 172.21.0.1:41704 - "POST /node/69e1ff36408ad4de24864da5 HTTP/1.0" 202 Accepted 2026-04-19 09:36:57,342 - lava_callback - INFO - Starting async job submit for node 69e1ff36408ad4de24864da5 2026-04-19 09:36:57,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:36:57,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ff36408ad4de24864da5 HTTP/1.1" 200 None 2026-04-19 09:36:57,362 - lava_callback - DEBUG - Processing node 69e1ff36408ad4de24864da5: baseline-arm64-baylibre 2026-04-19 09:36:57,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1ff36408ad4de24864da5 2026-04-19 09:36:57,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:36:57,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ff36408ad4de24864da5 HTTP/1.1" 200 None 2026-04-19 09:36:57,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:36:57,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:36:57,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:36:57,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1ff36408ad4de24864da5 HTTP/1.1" 200 None 2026-04-19 09:36:57,424 - lava_callback - ERROR - Error processing callback for node 69e1ff36408ad4de24864da5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:37:55,468 - lava_callback - INFO - Received callback for node 69e49e967ab9251d5f916df0 INFO: 172.21.0.1:40222 - "POST /node/69e49e967ab9251d5f916df0 HTTP/1.0" 202 Accepted 2026-04-19 09:37:55,476 - lava_callback - INFO - Starting async job submit for node 69e49e967ab9251d5f916df0 2026-04-19 09:37:55,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:37:55,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49e967ab9251d5f916df0 HTTP/1.1" 200 None 2026-04-19 09:37:55,534 - lava_callback - DEBUG - Processing node 69e49e967ab9251d5f916df0: baseline-x86 2026-04-19 09:37:56,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:37:56,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:37:56,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e967ab9251d5f916df0/log.txt.gz INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:37:56,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:37:57,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:37:57,151 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e967ab9251d5f916df0/lava-logs.yaml 2026-04-19 09:37:57,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:37:57,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:37:57,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e49e967ab9251d5f916df0/lava_callback.json.gz DEBUG: Setup failed for 69e49e967ab9251d5f916df0. Transitting job node result: incomplete -> fail 2026-04-19 09:37:57,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:37:57,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e49e967ab9251d5f916df0 HTTP/1.1" 200 None 2026-04-19 09:37:57,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:37:57,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f667ab9251d5f915ecc HTTP/1.1" 200 None 2026-04-19 09:37:57,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:37:57,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e49e967ab9251d5f916df0 HTTP/1.1" 200 None 2026-04-19 09:37:57,547 - lava_callback - INFO - Completed processing callback for node 69e49e967ab9251d5f916df0 2026-04-19 09:37:59,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:37:59,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:38:17,453 - lava_callback - INFO - Received callback for node 69e1ff83408ad4de24864dc6 INFO: 172.21.0.1:50400 - "POST /node/69e1ff83408ad4de24864dc6 HTTP/1.0" 202 Accepted 2026-04-19 09:38:17,460 - lava_callback - INFO - Starting async job submit for node 69e1ff83408ad4de24864dc6 2026-04-19 09:38:17,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:38:17,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ff83408ad4de24864dc6 HTTP/1.1" 200 None 2026-04-19 09:38:17,486 - lava_callback - DEBUG - Processing node 69e1ff83408ad4de24864dc6: baseline-arm64-baylibre 2026-04-19 09:38:17,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e1ff83408ad4de24864dc6 2026-04-19 09:38:17,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:38:17,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ff83408ad4de24864dc6 HTTP/1.1" 200 None 2026-04-19 09:38:17,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:38:17,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:38:17,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:38:17,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e1ff83408ad4de24864dc6 HTTP/1.1" 200 None 2026-04-19 09:38:17,554 - lava_callback - ERROR - Error processing callback for node 69e1ff83408ad4de24864dc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:40:57,643 - lava_callback - INFO - Received callback for node 69e2001d408ad4de24864e0a INFO: 172.21.0.1:48984 - "POST /node/69e2001d408ad4de24864e0a HTTP/1.0" 202 Accepted 2026-04-19 09:40:57,648 - lava_callback - INFO - Starting async job submit for node 69e2001d408ad4de24864e0a 2026-04-19 09:40:57,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:40:57,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2001d408ad4de24864e0a HTTP/1.1" 200 None 2026-04-19 09:40:57,664 - lava_callback - DEBUG - Processing node 69e2001d408ad4de24864e0a: baseline-arm64-baylibre 2026-04-19 09:40:57,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2001d408ad4de24864e0a 2026-04-19 09:40:57,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:40:57,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2001d408ad4de24864e0a HTTP/1.1" 200 None 2026-04-19 09:40:57,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:40:57,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:40:57,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:40:57,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2001d408ad4de24864e0a HTTP/1.1" 200 None 2026-04-19 09:40:57,738 - lava_callback - ERROR - Error processing callback for node 69e2001d408ad4de24864e0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:41:57,585 - lava_callback - INFO - Received callback for node 69e2005c408ad4de24864e27 INFO: 172.21.0.1:40210 - "POST /node/69e2005c408ad4de24864e27 HTTP/1.0" 202 Accepted 2026-04-19 09:41:57,591 - lava_callback - INFO - Starting async job submit for node 69e2005c408ad4de24864e27 2026-04-19 09:41:57,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:41:57,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2005c408ad4de24864e27 HTTP/1.1" 200 None 2026-04-19 09:41:57,616 - lava_callback - DEBUG - Processing node 69e2005c408ad4de24864e27: baseline-arm-baylibre 2026-04-19 09:41:57,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2005c408ad4de24864e27 2026-04-19 09:41:57,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:41:57,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2005c408ad4de24864e27 HTTP/1.1" 200 None 2026-04-19 09:41:57,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:41:57,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 09:41:57,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:41:57,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2005c408ad4de24864e27 HTTP/1.1" 200 None 2026-04-19 09:41:57,686 - lava_callback - ERROR - Error processing callback for node 69e2005c408ad4de24864e27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:43:17,682 - lava_callback - INFO - Received callback for node 69e200b1408ad4de24864e41 INFO: 172.21.0.1:44558 - "POST /node/69e200b1408ad4de24864e41 HTTP/1.0" 202 Accepted 2026-04-19 09:43:17,688 - lava_callback - INFO - Starting async job submit for node 69e200b1408ad4de24864e41 2026-04-19 09:43:17,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:43:17,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e200b1408ad4de24864e41 HTTP/1.1" 200 None 2026-04-19 09:43:17,704 - lava_callback - DEBUG - Processing node 69e200b1408ad4de24864e41: baseline-arm64-baylibre 2026-04-19 09:43:17,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e200b1408ad4de24864e41 2026-04-19 09:43:17,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:43:17,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e200b1408ad4de24864e41 HTTP/1.1" 200 None 2026-04-19 09:43:17,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:43:17,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:43:17,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:43:17,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e200b1408ad4de24864e41 HTTP/1.1" 200 None 2026-04-19 09:43:17,751 - lava_callback - ERROR - Error processing callback for node 69e200b1408ad4de24864e41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:46:57,917 - lava_callback - INFO - Received callback for node 69e20183408ad4de24864e97 INFO: 172.21.0.1:41898 - "POST /node/69e20183408ad4de24864e97 HTTP/1.0" 202 Accepted 2026-04-19 09:46:57,923 - lava_callback - INFO - Starting async job submit for node 69e20183408ad4de24864e97 2026-04-19 09:46:57,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:46:57,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20183408ad4de24864e97 HTTP/1.1" 200 None 2026-04-19 09:46:57,943 - lava_callback - DEBUG - Processing node 69e20183408ad4de24864e97: baseline-arm-baylibre 2026-04-19 09:46:57,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20183408ad4de24864e97 2026-04-19 09:46:57,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:46:57,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20183408ad4de24864e97 HTTP/1.1" 200 None 2026-04-19 09:46:57,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:46:57,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 09:46:57,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:46:57,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20183408ad4de24864e97 HTTP/1.1" 200 None 2026-04-19 09:46:57,996 - lava_callback - ERROR - Error processing callback for node 69e20183408ad4de24864e97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:47:37,862 - lava_callback - INFO - Received callback for node 69e201a7408ad4de24864ea2 INFO: 172.21.0.1:59342 - "POST /node/69e201a7408ad4de24864ea2 HTTP/1.0" 202 Accepted 2026-04-19 09:47:37,868 - lava_callback - INFO - Starting async job submit for node 69e201a7408ad4de24864ea2 2026-04-19 09:47:37,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:47:37,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e201a7408ad4de24864ea2 HTTP/1.1" 200 None 2026-04-19 09:47:37,883 - lava_callback - DEBUG - Processing node 69e201a7408ad4de24864ea2: baseline-arm-baylibre 2026-04-19 09:47:37,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e201a7408ad4de24864ea2 2026-04-19 09:47:37,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:47:37,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e201a7408ad4de24864ea2 HTTP/1.1" 200 None 2026-04-19 09:47:37,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:47:37,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 09:47:37,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:47:37,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e201a7408ad4de24864ea2 HTTP/1.1" 200 None 2026-04-19 09:47:37,930 - lava_callback - ERROR - Error processing callback for node 69e201a7408ad4de24864ea2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:49:58,090 - lava_callback - INFO - Received callback for node 69e2023d408ad4de24864ed7 INFO: 172.21.0.1:57536 - "POST /node/69e2023d408ad4de24864ed7 HTTP/1.0" 202 Accepted 2026-04-19 09:49:58,096 - lava_callback - INFO - Starting async job submit for node 69e2023d408ad4de24864ed7 2026-04-19 09:49:58,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:49:58,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2023d408ad4de24864ed7 HTTP/1.1" 200 None 2026-04-19 09:49:58,112 - lava_callback - DEBUG - Processing node 69e2023d408ad4de24864ed7: baseline-arm-baylibre 2026-04-19 09:49:58,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2023d408ad4de24864ed7 2026-04-19 09:49:58,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:49:58,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2023d408ad4de24864ed7 HTTP/1.1" 200 None 2026-04-19 09:49:58,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:49:58,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 09:49:58,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:49:58,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2023d408ad4de24864ed7 HTTP/1.1" 200 None 2026-04-19 09:49:58,173 - lava_callback - ERROR - Error processing callback for node 69e2023d408ad4de24864ed7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:51:58,203 - lava_callback - INFO - Received callback for node 69e202ac408ad4de24864efc INFO: 172.21.0.1:41550 - "POST /node/69e202ac408ad4de24864efc HTTP/1.0" 202 Accepted 2026-04-19 09:51:58,209 - lava_callback - INFO - Starting async job submit for node 69e202ac408ad4de24864efc 2026-04-19 09:51:58,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:51:58,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e202ac408ad4de24864efc HTTP/1.1" 200 None 2026-04-19 09:51:58,240 - lava_callback - DEBUG - Processing node 69e202ac408ad4de24864efc: baseline-arm-baylibre 2026-04-19 09:51:58,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e202ac408ad4de24864efc 2026-04-19 09:51:58,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:51:58,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e202ac408ad4de24864efc HTTP/1.1" 200 None 2026-04-19 09:51:58,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:51:58,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 09:51:58,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:51:58,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e202ac408ad4de24864efc HTTP/1.1" 200 None 2026-04-19 09:51:58,331 - lava_callback - ERROR - Error processing callback for node 69e202ac408ad4de24864efc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:52:18,217 - lava_callback - INFO - Received callback for node 69e202d0408ad4de24864f07 INFO: 172.21.0.1:43064 - "POST /node/69e202d0408ad4de24864f07 HTTP/1.0" 202 Accepted 2026-04-19 09:52:18,225 - lava_callback - INFO - Starting async job submit for node 69e202d0408ad4de24864f07 2026-04-19 09:52:18,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:52:18,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e202d0408ad4de24864f07 HTTP/1.1" 200 None 2026-04-19 09:52:18,247 - lava_callback - DEBUG - Processing node 69e202d0408ad4de24864f07: baseline-arm-baylibre 2026-04-19 09:52:18,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e202d0408ad4de24864f07 2026-04-19 09:52:18,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:52:18,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e202d0408ad4de24864f07 HTTP/1.1" 200 None 2026-04-19 09:52:18,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:52:18,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 09:52:18,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:52:18,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e202d0408ad4de24864f07 HTTP/1.1" 200 None 2026-04-19 09:52:18,302 - lava_callback - ERROR - Error processing callback for node 69e202d0408ad4de24864f07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:53:13,034 - lava_callback - INFO - Received callback for node 69e20304408ad4de24864f1b INFO: 172.21.0.1:44956 - "POST /node/69e20304408ad4de24864f1b HTTP/1.0" 202 Accepted 2026-04-19 09:53:13,040 - lava_callback - INFO - Starting async job submit for node 69e20304408ad4de24864f1b 2026-04-19 09:53:13,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:53:13,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20304408ad4de24864f1b HTTP/1.1" 200 None 2026-04-19 09:53:13,055 - lava_callback - DEBUG - Processing node 69e20304408ad4de24864f1b: baseline-arm64-clabbe 2026-04-19 09:53:13,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20304408ad4de24864f1b 2026-04-19 09:53:13,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:53:13,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20304408ad4de24864f1b HTTP/1.1" 200 None 2026-04-19 09:53:13,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:53:13,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:53:13,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:53:13,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20304408ad4de24864f1b HTTP/1.1" 200 None 2026-04-19 09:53:13,111 - lava_callback - ERROR - Error processing callback for node 69e20304408ad4de24864f1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:54:53,022 - lava_callback - INFO - Received callback for node 69e20366408ad4de24864f41 INFO: 172.21.0.1:48078 - "POST /node/69e20366408ad4de24864f41 HTTP/1.0" 202 Accepted 2026-04-19 09:54:53,031 - lava_callback - INFO - Starting async job submit for node 69e20366408ad4de24864f41 2026-04-19 09:54:53,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:54:53,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20366408ad4de24864f41 HTTP/1.1" 200 None 2026-04-19 09:54:53,047 - lava_callback - DEBUG - Processing node 69e20366408ad4de24864f41: baseline-arm-clabbe 2026-04-19 09:54:53,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20366408ad4de24864f41 2026-04-19 09:54:53,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:54:53,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20366408ad4de24864f41 HTTP/1.1" 200 None 2026-04-19 09:54:53,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:54:53,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 09:54:53,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:54:53,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20366408ad4de24864f41 HTTP/1.1" 200 None 2026-04-19 09:54:53,131 - lava_callback - ERROR - Error processing callback for node 69e20366408ad4de24864f41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:56:53,161 - lava_callback - INFO - Received callback for node 69e203cf408ad4de24864f66 INFO: 172.21.0.1:40246 - "POST /node/69e203cf408ad4de24864f66 HTTP/1.0" 202 Accepted 2026-04-19 09:56:53,167 - lava_callback - INFO - Starting async job submit for node 69e203cf408ad4de24864f66 2026-04-19 09:56:53,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:56:53,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e203cf408ad4de24864f66 HTTP/1.1" 200 None 2026-04-19 09:56:53,183 - lava_callback - DEBUG - Processing node 69e203cf408ad4de24864f66: baseline-arm-clabbe 2026-04-19 09:56:53,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e203cf408ad4de24864f66 2026-04-19 09:56:53,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:56:53,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e203cf408ad4de24864f66 HTTP/1.1" 200 None 2026-04-19 09:56:53,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:56:53,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 09:56:53,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:56:53,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e203cf408ad4de24864f66 HTTP/1.1" 200 None 2026-04-19 09:56:53,230 - lava_callback - ERROR - Error processing callback for node 69e203cf408ad4de24864f66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:58:53,197 - lava_callback - INFO - Received callback for node 69e20450408ad4de24864f92 INFO: 172.21.0.1:50438 - "POST /node/69e20450408ad4de24864f92 HTTP/1.0" 202 Accepted 2026-04-19 09:58:53,203 - lava_callback - INFO - Starting async job submit for node 69e20450408ad4de24864f92 2026-04-19 09:58:53,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:58:53,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20450408ad4de24864f92 HTTP/1.1" 200 None 2026-04-19 09:58:53,218 - lava_callback - DEBUG - Processing node 69e20450408ad4de24864f92: baseline-arm64-clabbe 2026-04-19 09:58:53,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20450408ad4de24864f92 2026-04-19 09:58:53,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:58:53,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20450408ad4de24864f92 HTTP/1.1" 200 None 2026-04-19 09:58:53,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:58:53,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 09:58:53,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:58:53,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20450408ad4de24864f92 HTTP/1.1" 200 None 2026-04-19 09:58:53,268 - lava_callback - ERROR - Error processing callback for node 69e20450408ad4de24864f92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:59:56,220 - lava_callback - INFO - Received callback for node 69e4a7507ab9251d5f9171fa INFO: 172.21.0.1:53646 - "POST /node/69e4a7507ab9251d5f9171fa HTTP/1.0" 202 Accepted 2026-04-19 09:59:56,226 - lava_callback - INFO - Starting async job submit for node 69e4a7507ab9251d5f9171fa 2026-04-19 09:59:56,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:59:56,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a7507ab9251d5f9171fa HTTP/1.1" 200 None 2026-04-19 09:59:56,277 - lava_callback - DEBUG - Processing node 69e4a7507ab9251d5f9171fa: baseline-arm64-kontron INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK 2026-04-19 09:59:56,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:59:56,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:59:56,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4a7507ab9251d5f9171fa/log.txt.gz 2026-04-19 09:59:56,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:59:57,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:59:57,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4a7507ab9251d5f9171fa/lava-logs.yaml 2026-04-19 09:59:57,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 09:59:57,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 09:59:57,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4a7507ab9251d5f9171fa/lava_callback.json.gz 2026-04-19 09:59:57,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:59:57,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a7507ab9251d5f9171fa HTTP/1.1" 200 None 2026-04-19 09:59:57,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:59:57,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 09:59:57,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:59:57,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a7507ab9251d5f9171fa HTTP/1.1" 200 None 2026-04-19 09:59:57,422 - lava_callback - INFO - Completed processing callback for node 69e4a7507ab9251d5f9171fa 2026-04-19 09:59:59,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 09:59:59,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:01:13,284 - lava_callback - INFO - Received callback for node 69e204da408ad4de24864fcd INFO: 172.21.0.1:52910 - "POST /node/69e204da408ad4de24864fcd HTTP/1.0" 202 Accepted 2026-04-19 10:01:13,289 - lava_callback - INFO - Starting async job submit for node 69e204da408ad4de24864fcd 2026-04-19 10:01:13,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:01:13,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e204da408ad4de24864fcd HTTP/1.1" 200 None 2026-04-19 10:01:13,304 - lava_callback - DEBUG - Processing node 69e204da408ad4de24864fcd: baseline-arm-clabbe 2026-04-19 10:01:13,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e204da408ad4de24864fcd 2026-04-19 10:01:13,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:01:13,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e204da408ad4de24864fcd HTTP/1.1" 200 None 2026-04-19 10:01:13,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:01:13,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:01:13,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:01:13,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e204da408ad4de24864fcd HTTP/1.1" 200 None 2026-04-19 10:01:13,358 - lava_callback - ERROR - Error processing callback for node 69e204da408ad4de24864fcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:02:13,308 - lava_callback - INFO - Received callback for node 69e2050f408ad4de24864fd6 INFO: 172.21.0.1:58276 - "POST /node/69e2050f408ad4de24864fd6 HTTP/1.0" 202 Accepted 2026-04-19 10:02:13,314 - lava_callback - INFO - Starting async job submit for node 69e2050f408ad4de24864fd6 2026-04-19 10:02:13,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:02:13,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2050f408ad4de24864fd6 HTTP/1.1" 200 None 2026-04-19 10:02:13,344 - lava_callback - DEBUG - Processing node 69e2050f408ad4de24864fd6: baseline-arm64-clabbe 2026-04-19 10:02:13,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2050f408ad4de24864fd6 2026-04-19 10:02:13,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:02:13,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2050f408ad4de24864fd6 HTTP/1.1" 200 None 2026-04-19 10:02:13,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:02:13,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:02:13,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:02:13,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2050f408ad4de24864fd6 HTTP/1.1" 200 None 2026-04-19 10:02:13,393 - lava_callback - ERROR - Error processing callback for node 69e2050f408ad4de24864fd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:04:18,903 - lava_callback - INFO - Received callback for node 69e205a0408ad4de24865013 INFO: 172.21.0.1:58254 - "POST /node/69e205a0408ad4de24865013 HTTP/1.0" 202 Accepted 2026-04-19 10:04:18,908 - lava_callback - INFO - Starting async job submit for node 69e205a0408ad4de24865013 2026-04-19 10:04:18,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:04:18,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e205a0408ad4de24865013 HTTP/1.1" 200 None 2026-04-19 10:04:18,939 - lava_callback - DEBUG - Processing node 69e205a0408ad4de24865013: baseline-arm64-baylibre 2026-04-19 10:04:18,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e205a0408ad4de24865013 2026-04-19 10:04:18,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:04:18,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e205a0408ad4de24865013 HTTP/1.1" 200 None 2026-04-19 10:04:18,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:04:19,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:04:19,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:04:19,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e205a0408ad4de24865013 HTTP/1.1" 200 None 2026-04-19 10:04:19,023 - lava_callback - ERROR - Error processing callback for node 69e205a0408ad4de24865013: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44434 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:06:53,580 - lava_callback - INFO - Received callback for node 69e20635408ad4de2486504d INFO: 172.21.0.1:46070 - "POST /node/69e20635408ad4de2486504d HTTP/1.0" 202 Accepted 2026-04-19 10:06:53,585 - lava_callback - INFO - Starting async job submit for node 69e20635408ad4de2486504d 2026-04-19 10:06:53,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:06:53,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20635408ad4de2486504d HTTP/1.1" 200 None 2026-04-19 10:06:53,602 - lava_callback - DEBUG - Processing node 69e20635408ad4de2486504d: baseline-arm-clabbe 2026-04-19 10:06:53,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20635408ad4de2486504d 2026-04-19 10:06:53,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:06:53,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20635408ad4de2486504d HTTP/1.1" 200 None 2026-04-19 10:06:53,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:06:53,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:06:53,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:06:53,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20635408ad4de2486504d HTTP/1.1" 200 None 2026-04-19 10:06:53,650 - lava_callback - ERROR - Error processing callback for node 69e20635408ad4de2486504d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41850 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:07:33,529 - lava_callback - INFO - Received callback for node 69e2065b408ad4de24865059 INFO: 172.21.0.1:39392 - "POST /node/69e2065b408ad4de24865059 HTTP/1.0" 202 Accepted 2026-04-19 10:07:33,535 - lava_callback - INFO - Starting async job submit for node 69e2065b408ad4de24865059 2026-04-19 10:07:33,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:33,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2065b408ad4de24865059 HTTP/1.1" 200 None 2026-04-19 10:07:33,556 - lava_callback - DEBUG - Processing node 69e2065b408ad4de24865059: baseline-arm-clabbe 2026-04-19 10:07:33,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2065b408ad4de24865059 2026-04-19 10:07:33,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:33,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2065b408ad4de24865059 HTTP/1.1" 200 None 2026-04-19 10:07:33,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:33,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:07:33,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:33,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2065b408ad4de24865059 HTTP/1.1" 200 None 2026-04-19 10:07:33,613 - lava_callback - ERROR - Error processing callback for node 69e2065b408ad4de24865059: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:07:57,696 - lava_callback - INFO - Received callback for node 69e4a7b27ab9251d5f917222 INFO: 172.21.0.1:42710 - "POST /node/69e4a7b27ab9251d5f917222 HTTP/1.0" 202 Accepted 2026-04-19 10:07:57,703 - lava_callback - INFO - Starting async job submit for node 69e4a7b27ab9251d5f917222 2026-04-19 10:07:57,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:57,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a7b27ab9251d5f917222 HTTP/1.1" 200 None 2026-04-19 10:07:57,754 - lava_callback - DEBUG - Processing node 69e4a7b27ab9251d5f917222: baseline-arm64 2026-04-19 10:07:58,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:07:58,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:07:58,682 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a7b27ab9251d5f917222/log.txt.gz 2026-04-19 10:07:59,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:07:59,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:07:59,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a7b27ab9251d5f917222/lava-logs.yaml 2026-04-19 10:07:59,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:07:59,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:07:59,456 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a7b27ab9251d5f917222/lava_callback.json.gz 2026-04-19 10:07:59,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:59,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a7b27ab9251d5f917222 HTTP/1.1" 200 None 2026-04-19 10:07:59,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:59,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:07:59,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:59,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a7b27ab9251d5f917222 HTTP/1.1" 200 None 2026-04-19 10:07:59,542 - lava_callback - INFO - Completed processing callback for node 69e4a7b27ab9251d5f917222 2026-04-19 10:07:59,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:07:59,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:10:53,713 - lava_callback - INFO - Received callback for node 69e20719408ad4de248650a3 INFO: 172.21.0.1:51896 - "POST /node/69e20719408ad4de248650a3 HTTP/1.0" 202 Accepted 2026-04-19 10:10:53,718 - lava_callback - INFO - Starting async job submit for node 69e20719408ad4de248650a3 2026-04-19 10:10:53,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:10:53,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20719408ad4de248650a3 HTTP/1.1" 200 None 2026-04-19 10:10:53,734 - lava_callback - DEBUG - Processing node 69e20719408ad4de248650a3: baseline-arm-clabbe 2026-04-19 10:10:53,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20719408ad4de248650a3 2026-04-19 10:10:53,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:10:53,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20719408ad4de248650a3 HTTP/1.1" 200 None 2026-04-19 10:10:53,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:10:53,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:10:53,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:10:53,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20719408ad4de248650a3 HTTP/1.1" 200 None 2026-04-19 10:10:53,781 - lava_callback - ERROR - Error processing callback for node 69e20719408ad4de248650a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:11:13,675 - lava_callback - INFO - Received callback for node 69e2073e408ad4de248650ac INFO: 172.21.0.1:47564 - "POST /node/69e2073e408ad4de248650ac HTTP/1.0" 202 Accepted 2026-04-19 10:11:13,681 - lava_callback - INFO - Starting async job submit for node 69e2073e408ad4de248650ac 2026-04-19 10:11:13,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:11:13,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2073e408ad4de248650ac HTTP/1.1" 200 None 2026-04-19 10:11:13,698 - lava_callback - DEBUG - Processing node 69e2073e408ad4de248650ac: baseline-arm-clabbe 2026-04-19 10:11:13,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2073e408ad4de248650ac 2026-04-19 10:11:13,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:11:13,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2073e408ad4de248650ac HTTP/1.1" 200 None 2026-04-19 10:11:13,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:11:13,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:11:13,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:11:13,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2073e408ad4de248650ac HTTP/1.1" 200 None 2026-04-19 10:11:13,752 - lava_callback - ERROR - Error processing callback for node 69e2073e408ad4de248650ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:11:59,375 - lava_callback - INFO - Received callback for node 69e2076c408ad4de248650b7 INFO: 172.21.0.1:54964 - "POST /node/69e2076c408ad4de248650b7 HTTP/1.0" 202 Accepted 2026-04-19 10:11:59,381 - lava_callback - INFO - Starting async job submit for node 69e2076c408ad4de248650b7 2026-04-19 10:11:59,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:11:59,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2076c408ad4de248650b7 HTTP/1.1" 200 None 2026-04-19 10:11:59,398 - lava_callback - DEBUG - Processing node 69e2076c408ad4de248650b7: baseline-arm64-baylibre 2026-04-19 10:11:59,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2076c408ad4de248650b7 2026-04-19 10:11:59,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:11:59,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2076c408ad4de248650b7 HTTP/1.1" 200 None 2026-04-19 10:11:59,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:11:59,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:11:59,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:11:59,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2076c408ad4de248650b7 HTTP/1.1" 200 None 2026-04-19 10:11:59,456 - lava_callback - ERROR - Error processing callback for node 69e2076c408ad4de248650b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:13:33,832 - lava_callback - INFO - Received callback for node 69e207c6408ad4de248650d4 INFO: 172.21.0.1:42334 - "POST /node/69e207c6408ad4de248650d4 HTTP/1.0" 202 Accepted 2026-04-19 10:13:33,837 - lava_callback - INFO - Starting async job submit for node 69e207c6408ad4de248650d4 2026-04-19 10:13:33,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:13:33,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e207c6408ad4de248650d4 HTTP/1.1" 200 None 2026-04-19 10:13:33,856 - lava_callback - DEBUG - Processing node 69e207c6408ad4de248650d4: baseline-arm64-clabbe 2026-04-19 10:13:33,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e207c6408ad4de248650d4 2026-04-19 10:13:33,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:13:33,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e207c6408ad4de248650d4 HTTP/1.1" 200 None 2026-04-19 10:13:33,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:13:33,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:13:33,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:13:33,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e207c6408ad4de248650d4 HTTP/1.1" 200 None 2026-04-19 10:13:33,903 - lava_callback - ERROR - Error processing callback for node 69e207c6408ad4de248650d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:14:00,792 - lava_callback - INFO - Received callback for node 69e4a6257ab9251d5f917187 INFO: 172.21.0.1:38632 - "POST /node/69e4a6257ab9251d5f917187 HTTP/1.0" 202 Accepted 2026-04-19 10:14:00,798 - lava_callback - INFO - Starting async job submit for node 69e4a6257ab9251d5f917187 2026-04-19 10:14:00,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:14:00,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a6257ab9251d5f917187 HTTP/1.1" 200 None 2026-04-19 10:14:00,835 - lava_callback - DEBUG - Processing node 69e4a6257ab9251d5f917187: baseline-arm64 2026-04-19 10:14:01,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:14:01,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:14:01,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a6257ab9251d5f917187/log.txt.gz 2026-04-19 10:14:01,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:14:01,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:14:01,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a6257ab9251d5f917187/lava-logs.yaml 2026-04-19 10:14:01,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:14:01,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:14:01,535 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4a6257ab9251d5f917187/lava_callback.json.gz DEBUG: Setup failed for 69e4a6257ab9251d5f917187. Transitting job node result: incomplete -> fail 2026-04-19 10:14:01,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:14:01,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a6257ab9251d5f917187 HTTP/1.1" 200 None 2026-04-19 10:14:01,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:14:01,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:14:01,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:14:01,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a6257ab9251d5f917187 HTTP/1.1" 200 None 2026-04-19 10:14:01,713 - lava_callback - INFO - Completed processing callback for node 69e4a6257ab9251d5f917187 INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:14:29,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:14:29,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:15:53,869 - lava_callback - INFO - Received callback for node 69e20851408ad4de24865115 INFO: 172.21.0.1:56358 - "POST /node/69e20851408ad4de24865115 HTTP/1.0" 202 Accepted 2026-04-19 10:15:53,875 - lava_callback - INFO - Starting async job submit for node 69e20851408ad4de24865115 2026-04-19 10:15:53,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:15:53,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20851408ad4de24865115 HTTP/1.1" 200 None 2026-04-19 10:15:53,901 - lava_callback - DEBUG - Processing node 69e20851408ad4de24865115: baseline-arm-clabbe 2026-04-19 10:15:53,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20851408ad4de24865115 2026-04-19 10:15:53,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:15:53,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20851408ad4de24865115 HTTP/1.1" 200 None 2026-04-19 10:15:53,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:15:53,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:15:53,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:15:53,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20851408ad4de24865115 HTTP/1.1" 200 None 2026-04-19 10:15:53,956 - lava_callback - ERROR - Error processing callback for node 69e20851408ad4de24865115: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:17:59,634 - lava_callback - INFO - Received callback for node 69e208c8408ad4de24865142 INFO: 172.21.0.1:47472 - "POST /node/69e208c8408ad4de24865142 HTTP/1.0" 202 Accepted 2026-04-19 10:17:59,640 - lava_callback - INFO - Starting async job submit for node 69e208c8408ad4de24865142 2026-04-19 10:17:59,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:17:59,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e208c8408ad4de24865142 HTTP/1.1" 200 None 2026-04-19 10:17:59,660 - lava_callback - DEBUG - Processing node 69e208c8408ad4de24865142: baseline-arm64-baylibre 2026-04-19 10:17:59,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e208c8408ad4de24865142 2026-04-19 10:17:59,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:17:59,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e208c8408ad4de24865142 HTTP/1.1" 200 None 2026-04-19 10:17:59,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:17:59,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:17:59,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:17:59,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e208c8408ad4de24865142 HTTP/1.1" 200 None 2026-04-19 10:17:59,724 - lava_callback - ERROR - Error processing callback for node 69e208c8408ad4de24865142: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:19:14,077 - lava_callback - INFO - Received callback for node 69e2091c408ad4de24865163 INFO: 172.21.0.1:33926 - "POST /node/69e2091c408ad4de24865163 HTTP/1.0" 202 Accepted 2026-04-19 10:19:14,082 - lava_callback - INFO - Starting async job submit for node 69e2091c408ad4de24865163 2026-04-19 10:19:14,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:14,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2091c408ad4de24865163 HTTP/1.1" 200 None 2026-04-19 10:19:14,098 - lava_callback - DEBUG - Processing node 69e2091c408ad4de24865163: baseline-arm64-clabbe 2026-04-19 10:19:14,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2091c408ad4de24865163 2026-04-19 10:19:14,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:14,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2091c408ad4de24865163 HTTP/1.1" 200 None 2026-04-19 10:19:14,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:14,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:19:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:14,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2091c408ad4de24865163 HTTP/1.1" 200 None 2026-04-19 10:19:14,150 - lava_callback - ERROR - Error processing callback for node 69e2091c408ad4de24865163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:19:23,390 - lava_callback - INFO - Received callback for node 69e4ac0a7ab9251d5f917408 INFO: 172.21.0.1:37996 - "POST /node/69e4ac0a7ab9251d5f917408 HTTP/1.0" 202 Accepted 2026-04-19 10:19:23,396 - lava_callback - INFO - Starting async job submit for node 69e4ac0a7ab9251d5f917408 2026-04-19 10:19:23,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:23,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ac0a7ab9251d5f917408 HTTP/1.1" 200 None 2026-04-19 10:19:23,414 - lava_callback - DEBUG - Processing node 69e4ac0a7ab9251d5f917408: baseline-nfs-arm64 2026-04-19 10:19:23,416 - lava_callback - WARNING - Failed to upload log 2026-04-19 10:19:23,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:19:23,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:19:23,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4ac0a7ab9251d5f917408/lava-logs.yaml 2026-04-19 10:19:23,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:19:23,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:19:23,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4ac0a7ab9251d5f917408/lava_callback.json.gz 2026-04-19 10:19:23,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:23,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ac0a7ab9251d5f917408 HTTP/1.1" 200 None 2026-04-19 10:19:23,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:23,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:19:23,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:23,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4ac0a7ab9251d5f917408 HTTP/1.1" 200 None 2026-04-19 10:19:23,715 - lava_callback - INFO - Completed processing callback for node 69e4ac0a7ab9251d5f917408 INFO: 172.21.0.1:38000 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:19:29,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:19:29,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:20:34,073 - lava_callback - INFO - Received callback for node 69e2095c408ad4de2486517f INFO: 172.21.0.1:58112 - "POST /node/69e2095c408ad4de2486517f HTTP/1.0" 202 Accepted 2026-04-19 10:20:34,078 - lava_callback - INFO - Starting async job submit for node 69e2095c408ad4de2486517f 2026-04-19 10:20:34,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:20:34,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2095c408ad4de2486517f HTTP/1.1" 200 None 2026-04-19 10:20:34,094 - lava_callback - DEBUG - Processing node 69e2095c408ad4de2486517f: baseline-arm-clabbe 2026-04-19 10:20:34,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2095c408ad4de2486517f 2026-04-19 10:20:34,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:20:34,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2095c408ad4de2486517f HTTP/1.1" 200 None 2026-04-19 10:20:34,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:20:34,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:20:34,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:20:34,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2095c408ad4de2486517f HTTP/1.1" 200 None 2026-04-19 10:20:34,158 - lava_callback - ERROR - Error processing callback for node 69e2095c408ad4de2486517f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:21:14,059 - lava_callback - INFO - Received callback for node 69e2098f408ad4de24865192 INFO: 172.21.0.1:54764 - "POST /node/69e2098f408ad4de24865192 HTTP/1.0" 202 Accepted 2026-04-19 10:21:14,065 - lava_callback - INFO - Starting async job submit for node 69e2098f408ad4de24865192 2026-04-19 10:21:14,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:14,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2098f408ad4de24865192 HTTP/1.1" 200 None 2026-04-19 10:21:14,080 - lava_callback - DEBUG - Processing node 69e2098f408ad4de24865192: baseline-arm64-clabbe 2026-04-19 10:21:14,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2098f408ad4de24865192 2026-04-19 10:21:14,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:14,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2098f408ad4de24865192 HTTP/1.1" 200 None 2026-04-19 10:21:14,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:14,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:21:14,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:14,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2098f408ad4de24865192 HTTP/1.1" 200 None 2026-04-19 10:21:14,127 - lava_callback - ERROR - Error processing callback for node 69e2098f408ad4de24865192: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:21:39,116 - lava_callback - INFO - Received callback for node 69e4a8017ab9251d5f91725c INFO: 172.21.0.1:54194 - "POST /node/69e4a8017ab9251d5f91725c HTTP/1.0" 202 Accepted 2026-04-19 10:21:39,124 - lava_callback - INFO - Starting async job submit for node 69e4a8017ab9251d5f91725c 2026-04-19 10:21:39,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:39,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a8017ab9251d5f91725c HTTP/1.1" 200 None 2026-04-19 10:21:39,183 - lava_callback - DEBUG - Processing node 69e4a8017ab9251d5f91725c: baseline-nfs-arm64 2026-04-19 10:21:40,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:21:40,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:21:40,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a8017ab9251d5f91725c/log.txt.gz 2026-04-19 10:21:41,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:21:41,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:21:41,349 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a8017ab9251d5f91725c/lava-logs.yaml 2026-04-19 10:21:41,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:21:41,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:21:41,532 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a8017ab9251d5f91725c/lava_callback.json.gz DEBUG: Setup failed for 69e4a8017ab9251d5f91725c. Transitting job node result: incomplete -> fail 2026-04-19 10:21:41,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:41,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a8017ab9251d5f91725c HTTP/1.1" 200 None 2026-04-19 10:21:41,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:41,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:21:41,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:41,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a8017ab9251d5f91725c HTTP/1.1" 200 None 2026-04-19 10:21:41,828 - lava_callback - INFO - Completed processing callback for node 69e4a8017ab9251d5f91725c INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32836 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:21:59,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:21:59,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-19 10:22:03,634 - lava_callback - INFO - Received callback for node 69e4ac9f7ab9251d5f917471 INFO: 172.21.0.1:37628 - "POST /node/69e4ac9f7ab9251d5f917471 HTTP/1.0" 202 Accepted 2026-04-19 10:22:03,641 - lava_callback - INFO - Starting async job submit for node 69e4ac9f7ab9251d5f917471 2026-04-19 10:22:03,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:22:03,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ac9f7ab9251d5f917471 HTTP/1.1" 200 None 2026-04-19 10:22:03,694 - lava_callback - DEBUG - Processing node 69e4ac9f7ab9251d5f917471: baseline-arm64 2026-04-19 10:22:03,848 - lava_callback - WARNING - Failed to upload log 2026-04-19 10:22:03,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:22:04,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:22:04,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4ac9f7ab9251d5f917471/lava-logs.yaml 2026-04-19 10:22:04,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:22:04,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:22:04,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4ac9f7ab9251d5f917471/lava_callback.json.gz 2026-04-19 10:22:04,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:22:04,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ac9f7ab9251d5f917471 HTTP/1.1" 200 None 2026-04-19 10:22:04,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:22:04,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:22:04,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:22:04,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4ac9f7ab9251d5f917471 HTTP/1.1" 200 None 2026-04-19 10:22:04,315 - lava_callback - INFO - Completed processing callback for node 69e4ac9f7ab9251d5f917471 INFO: 172.21.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:22:29,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:22:29,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35132 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:23:40,054 - lava_callback - INFO - Received callback for node 69e20a20408ad4de248651d4 INFO: 172.21.0.1:33766 - "POST /node/69e20a20408ad4de248651d4 HTTP/1.0" 202 Accepted 2026-04-19 10:23:40,060 - lava_callback - INFO - Starting async job submit for node 69e20a20408ad4de248651d4 2026-04-19 10:23:40,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:23:40,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20a20408ad4de248651d4 HTTP/1.1" 200 None 2026-04-19 10:23:40,076 - lava_callback - DEBUG - Processing node 69e20a20408ad4de248651d4: baseline-arm64-baylibre 2026-04-19 10:23:40,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20a20408ad4de248651d4 2026-04-19 10:23:40,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:23:40,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20a20408ad4de248651d4 HTTP/1.1" 200 None 2026-04-19 10:23:40,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:23:40,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:23:40,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:23:40,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20a20408ad4de248651d4 HTTP/1.1" 200 None 2026-04-19 10:23:40,133 - lava_callback - ERROR - Error processing callback for node 69e20a20408ad4de248651d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:24:54,275 - lava_callback - INFO - Received callback for node 69e20a71408ad4de248651ee INFO: 172.21.0.1:38396 - "POST /node/69e20a71408ad4de248651ee HTTP/1.0" 202 Accepted 2026-04-19 10:24:54,281 - lava_callback - INFO - Starting async job submit for node 69e20a71408ad4de248651ee 2026-04-19 10:24:54,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:24:54,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20a71408ad4de248651ee HTTP/1.1" 200 None 2026-04-19 10:24:54,305 - lava_callback - DEBUG - Processing node 69e20a71408ad4de248651ee: baseline-arm64-clabbe 2026-04-19 10:24:54,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20a71408ad4de248651ee 2026-04-19 10:24:54,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:24:54,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20a71408ad4de248651ee HTTP/1.1" 200 None 2026-04-19 10:24:54,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:24:54,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:24:54,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:24:54,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20a71408ad4de248651ee HTTP/1.1" 200 None 2026-04-19 10:24:54,357 - lava_callback - ERROR - Error processing callback for node 69e20a71408ad4de248651ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:26:20,184 - lava_callback - INFO - Received callback for node 69e20ab9408ad4de2486521a INFO: 172.21.0.1:43466 - "POST /node/69e20ab9408ad4de2486521a HTTP/1.0" 202 Accepted 2026-04-19 10:26:20,192 - lava_callback - INFO - Starting async job submit for node 69e20ab9408ad4de2486521a 2026-04-19 10:26:20,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:26:20,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20ab9408ad4de2486521a HTTP/1.1" 200 None 2026-04-19 10:26:20,216 - lava_callback - DEBUG - Processing node 69e20ab9408ad4de2486521a: baseline-arm64-baylibre 2026-04-19 10:26:20,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20ab9408ad4de2486521a 2026-04-19 10:26:20,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:26:20,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20ab9408ad4de2486521a HTTP/1.1" 200 None 2026-04-19 10:26:20,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:26:20,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:26:20,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:26:20,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20ab9408ad4de2486521a HTTP/1.1" 200 None 2026-04-19 10:26:20,272 - lava_callback - ERROR - Error processing callback for node 69e20ab9408ad4de2486521a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:26:47,866 - lava_callback - INFO - Received callback for node 69e4acf37ab9251d5f9174a2 INFO: 172.21.0.1:51288 - "POST /node/69e4acf37ab9251d5f9174a2 HTTP/1.0" 202 Accepted 2026-04-19 10:26:47,874 - lava_callback - INFO - Starting async job submit for node 69e4acf37ab9251d5f9174a2 2026-04-19 10:26:47,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:26:47,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4acf37ab9251d5f9174a2 HTTP/1.1" 200 None 2026-04-19 10:26:47,935 - lava_callback - DEBUG - Processing node 69e4acf37ab9251d5f9174a2: baseline-arm64 2026-04-19 10:26:48,158 - lava_callback - WARNING - Failed to upload log 2026-04-19 10:26:48,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:26:48,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:26:48,470 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4acf37ab9251d5f9174a2/lava-logs.yaml 2026-04-19 10:26:48,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:26:48,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:26:48,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4acf37ab9251d5f9174a2/lava_callback.json.gz 2026-04-19 10:26:48,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:26:48,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4acf37ab9251d5f9174a2 HTTP/1.1" 200 None 2026-04-19 10:26:48,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:26:48,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:26:48,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:26:48,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4acf37ab9251d5f9174a2 HTTP/1.1" 200 None 2026-04-19 10:26:48,717 - lava_callback - INFO - Completed processing callback for node 69e4acf37ab9251d5f9174a2 INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:26:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:27:00,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:27:40,120 - lava_callback - INFO - Received callback for node 69e20b07408ad4de24865236 INFO: 172.21.0.1:50556 - "POST /node/69e20b07408ad4de24865236 HTTP/1.0" 202 Accepted 2026-04-19 10:27:40,126 - lava_callback - INFO - Starting async job submit for node 69e20b07408ad4de24865236 2026-04-19 10:27:40,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:27:40,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20b07408ad4de24865236 HTTP/1.1" 200 None 2026-04-19 10:27:40,143 - lava_callback - DEBUG - Processing node 69e20b07408ad4de24865236: baseline-arm64-baylibre 2026-04-19 10:27:40,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20b07408ad4de24865236 2026-04-19 10:27:40,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:27:40,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20b07408ad4de24865236 HTTP/1.1" 200 None 2026-04-19 10:27:40,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:27:40,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:27:40,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:27:40,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20b07408ad4de24865236 HTTP/1.1" 200 None 2026-04-19 10:27:40,222 - lava_callback - ERROR - Error processing callback for node 69e20b07408ad4de24865236: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:28:19,103 - lava_callback - INFO - Received callback for node 69e4aa117ab9251d5f917339 INFO: 172.21.0.1:34358 - "POST /node/69e4aa117ab9251d5f917339 HTTP/1.0" 202 Accepted 2026-04-19 10:28:19,109 - lava_callback - INFO - Starting async job submit for node 69e4aa117ab9251d5f917339 2026-04-19 10:28:19,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:19,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4aa117ab9251d5f917339 HTTP/1.1" 200 None 2026-04-19 10:28:19,183 - lava_callback - DEBUG - Processing node 69e4aa117ab9251d5f917339: ltp-smoke 2026-04-19 10:28:19,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:28:19,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:28:19,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e4aa117ab9251d5f917339/log.txt.gz 2026-04-19 10:28:20,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:28:20,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:28:20,320 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e4aa117ab9251d5f917339/lava-logs.yaml 2026-04-19 10:28:20,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:28:20,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:28:20,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e4aa117ab9251d5f917339/lava_callback.json.gz 2026-04-19 10:28:20,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:20,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4aa117ab9251d5f917339 HTTP/1.1" 200 None 2026-04-19 10:28:20,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:20,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f4e7ab9251d5f915ea5 HTTP/1.1" 200 None 2026-04-19 10:28:20,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:20,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4aa117ab9251d5f917339 HTTP/1.1" 200 None 2026-04-19 10:28:20,726 - lava_callback - INFO - Completed processing callback for node 69e4aa117ab9251d5f917339 INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:28:30,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:30,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:28:57,249 - lava_callback - INFO - Received callback for node 69e4ae137ab9251d5f9174f5 INFO: 172.21.0.1:60574 - "POST /node/69e4ae137ab9251d5f9174f5 HTTP/1.0" 202 Accepted 2026-04-19 10:28:57,255 - lava_callback - INFO - Starting async job submit for node 69e4ae137ab9251d5f9174f5 2026-04-19 10:28:57,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:57,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ae137ab9251d5f9174f5 HTTP/1.1" 200 None 2026-04-19 10:28:57,305 - lava_callback - DEBUG - Processing node 69e4ae137ab9251d5f9174f5: baseline-arm64-kontron 2026-04-19 10:28:57,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:28:57,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:28:57,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4ae137ab9251d5f9174f5/log.txt.gz 2026-04-19 10:28:57,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:28:57,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:28:57,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4ae137ab9251d5f9174f5/lava-logs.yaml 2026-04-19 10:28:57,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:28:58,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:28:58,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e4ae137ab9251d5f9174f5/lava_callback.json.gz 2026-04-19 10:28:58,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:58,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ae137ab9251d5f9174f5 HTTP/1.1" 200 None 2026-04-19 10:28:58,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:58,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:28:58,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:28:58,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4ae137ab9251d5f9174f5 HTTP/1.1" 200 None 2026-04-19 10:28:58,247 - lava_callback - INFO - Completed processing callback for node 69e4ae137ab9251d5f9174f5 2026-04-19 10:29:00,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:29:00,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58836 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:29:34,434 - lava_callback - INFO - Received callback for node 69e20b7b408ad4de24865262 INFO: 172.21.0.1:50896 - "POST /node/69e20b7b408ad4de24865262 HTTP/1.0" 202 Accepted 2026-04-19 10:29:34,440 - lava_callback - INFO - Starting async job submit for node 69e20b7b408ad4de24865262 2026-04-19 10:29:34,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:29:34,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20b7b408ad4de24865262 HTTP/1.1" 200 None 2026-04-19 10:29:34,456 - lava_callback - DEBUG - Processing node 69e20b7b408ad4de24865262: baseline-arm64-clabbe 2026-04-19 10:29:34,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20b7b408ad4de24865262 2026-04-19 10:29:34,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:29:34,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20b7b408ad4de24865262 HTTP/1.1" 200 None 2026-04-19 10:29:34,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:29:34,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:29:34,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:29:34,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20b7b408ad4de24865262 HTTP/1.1" 200 None 2026-04-19 10:29:34,512 - lava_callback - ERROR - Error processing callback for node 69e20b7b408ad4de24865262: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:30:54,491 - lava_callback - INFO - Received callback for node 69e20bc8408ad4de24865298 INFO: 172.21.0.1:57040 - "POST /node/69e20bc8408ad4de24865298 HTTP/1.0" 202 Accepted 2026-04-19 10:30:54,497 - lava_callback - INFO - Starting async job submit for node 69e20bc8408ad4de24865298 2026-04-19 10:30:54,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:30:54,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20bc8408ad4de24865298 HTTP/1.1" 200 None 2026-04-19 10:30:54,514 - lava_callback - DEBUG - Processing node 69e20bc8408ad4de24865298: baseline-arm64-clabbe 2026-04-19 10:30:54,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20bc8408ad4de24865298 2026-04-19 10:30:54,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:30:54,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20bc8408ad4de24865298 HTTP/1.1" 200 None 2026-04-19 10:30:54,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:30:54,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:30:54,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:30:54,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20bc8408ad4de24865298 HTTP/1.1" 200 None 2026-04-19 10:30:54,563 - lava_callback - ERROR - Error processing callback for node 69e20bc8408ad4de24865298: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:31:54,538 - lava_callback - INFO - Received callback for node 69e20c16408ad4de248652b1 INFO: 172.21.0.1:38578 - "POST /node/69e20c16408ad4de248652b1 HTTP/1.0" 202 Accepted 2026-04-19 10:31:54,544 - lava_callback - INFO - Starting async job submit for node 69e20c16408ad4de248652b1 2026-04-19 10:31:54,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:31:54,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20c16408ad4de248652b1 HTTP/1.1" 200 None 2026-04-19 10:31:54,560 - lava_callback - DEBUG - Processing node 69e20c16408ad4de248652b1: baseline-arm64-clabbe 2026-04-19 10:31:54,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20c16408ad4de248652b1 2026-04-19 10:31:54,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:31:54,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20c16408ad4de248652b1 HTTP/1.1" 200 None 2026-04-19 10:31:54,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:31:54,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:31:54,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:31:54,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20c16408ad4de248652b1 HTTP/1.1" 200 None 2026-04-19 10:31:54,609 - lava_callback - ERROR - Error processing callback for node 69e20c16408ad4de248652b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:33:14,624 - lava_callback - INFO - Received callback for node 69e20c64408ad4de248652df INFO: 172.21.0.1:40368 - "POST /node/69e20c64408ad4de248652df HTTP/1.0" 202 Accepted 2026-04-19 10:33:14,630 - lava_callback - INFO - Starting async job submit for node 69e20c64408ad4de248652df 2026-04-19 10:33:14,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:33:14,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20c64408ad4de248652df HTTP/1.1" 200 None 2026-04-19 10:33:14,651 - lava_callback - DEBUG - Processing node 69e20c64408ad4de248652df: baseline-arm64-clabbe 2026-04-19 10:33:14,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20c64408ad4de248652df 2026-04-19 10:33:14,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:33:14,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20c64408ad4de248652df HTTP/1.1" 200 None 2026-04-19 10:33:14,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:33:14,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:33:14,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:33:14,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20c64408ad4de248652df HTTP/1.1" 200 None 2026-04-19 10:33:14,700 - lava_callback - ERROR - Error processing callback for node 69e20c64408ad4de248652df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48936 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:34:34,607 - lava_callback - INFO - Received callback for node 69e20cb3408ad4de2486530d INFO: 172.21.0.1:60612 - "POST /node/69e20cb3408ad4de2486530d HTTP/1.0" 202 Accepted 2026-04-19 10:34:34,613 - lava_callback - INFO - Starting async job submit for node 69e20cb3408ad4de2486530d 2026-04-19 10:34:34,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:34:34,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20cb3408ad4de2486530d HTTP/1.1" 200 None 2026-04-19 10:34:34,631 - lava_callback - DEBUG - Processing node 69e20cb3408ad4de2486530d: baseline-arm64-clabbe 2026-04-19 10:34:34,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20cb3408ad4de2486530d 2026-04-19 10:34:34,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:34:34,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20cb3408ad4de2486530d HTTP/1.1" 200 None 2026-04-19 10:34:34,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:34:34,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:34:34,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:34:34,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20cb3408ad4de2486530d HTTP/1.1" 200 None 2026-04-19 10:34:34,690 - lava_callback - ERROR - Error processing callback for node 69e20cb3408ad4de2486530d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:34:50,970 - lava_callback - INFO - Received callback for node 69e4a8757ab9251d5f917292 INFO: 172.21.0.1:34348 - "POST /node/69e4a8757ab9251d5f917292 HTTP/1.0" 202 Accepted 2026-04-19 10:34:50,976 - lava_callback - INFO - Starting async job submit for node 69e4a8757ab9251d5f917292 2026-04-19 10:34:50,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:34:51,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a8757ab9251d5f917292 HTTP/1.1" 200 None 2026-04-19 10:34:51,014 - lava_callback - DEBUG - Processing node 69e4a8757ab9251d5f917292: baseline-nfs-arm64 2026-04-19 10:34:51,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:34:51,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:34:51,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a8757ab9251d5f917292/log.txt.gz 2026-04-19 10:34:51,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:34:51,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:34:51,616 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a8757ab9251d5f917292/lava-logs.yaml 2026-04-19 10:34:51,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:34:51,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:34:51,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a8757ab9251d5f917292/lava_callback.json.gz DEBUG: Setup failed for 69e4a8757ab9251d5f917292. Transitting job node result: incomplete -> fail 2026-04-19 10:34:51,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:34:51,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a8757ab9251d5f917292 HTTP/1.1" 200 None 2026-04-19 10:34:51,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:34:51,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:34:51,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:34:51,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a8757ab9251d5f917292 HTTP/1.1" 200 None 2026-04-19 10:34:51,911 - lava_callback - INFO - Completed processing callback for node 69e4a8757ab9251d5f917292 INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:35:00,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:35:00,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:35:54,718 - lava_callback - INFO - Received callback for node 69e20d00408ad4de2486532a INFO: 172.21.0.1:35706 - "POST /node/69e20d00408ad4de2486532a HTTP/1.0" 202 Accepted 2026-04-19 10:35:54,723 - lava_callback - INFO - Starting async job submit for node 69e20d00408ad4de2486532a 2026-04-19 10:35:54,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:35:54,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20d00408ad4de2486532a HTTP/1.1" 200 None 2026-04-19 10:35:54,739 - lava_callback - DEBUG - Processing node 69e20d00408ad4de2486532a: baseline-arm64-clabbe 2026-04-19 10:35:54,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20d00408ad4de2486532a 2026-04-19 10:35:54,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:35:54,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20d00408ad4de2486532a HTTP/1.1" 200 None 2026-04-19 10:35:54,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:35:54,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:35:54,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:35:54,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20d00408ad4de2486532a HTTP/1.1" 200 None 2026-04-19 10:35:54,793 - lava_callback - ERROR - Error processing callback for node 69e20d00408ad4de2486532a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:36:40,326 - lava_callback - INFO - Received callback for node 69e4ac567ab9251d5f917449 INFO: 172.21.0.1:54356 - "POST /node/69e4ac567ab9251d5f917449 HTTP/1.0" 202 Accepted 2026-04-19 10:36:40,333 - lava_callback - INFO - Starting async job submit for node 69e4ac567ab9251d5f917449 2026-04-19 10:36:40,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:36:40,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ac567ab9251d5f917449 HTTP/1.1" 200 None 2026-04-19 10:36:40,384 - lava_callback - DEBUG - Processing node 69e4ac567ab9251d5f917449: baseline-arm64 2026-04-19 10:36:40,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:36:40,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:36:40,869 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4ac567ab9251d5f917449/log.txt.gz 2026-04-19 10:36:41,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:36:41,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:36:41,367 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4ac567ab9251d5f917449/lava-logs.yaml 2026-04-19 10:36:41,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:36:41,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:36:41,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4ac567ab9251d5f917449/lava_callback.json.gz DEBUG: Setup failed for 69e4ac567ab9251d5f917449. Transitting job node result: incomplete -> fail 2026-04-19 10:36:41,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:36:41,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ac567ab9251d5f917449 HTTP/1.1" 200 None 2026-04-19 10:36:41,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:36:41,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:36:41,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:36:41,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4ac567ab9251d5f917449 HTTP/1.1" 200 None 2026-04-19 10:36:41,806 - lava_callback - INFO - Completed processing callback for node 69e4ac567ab9251d5f917449 INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:37:00,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:37:00,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:37:14,756 - lava_callback - INFO - Received callback for node 69e20d4f408ad4de24865357 INFO: 172.21.0.1:53824 - "POST /node/69e20d4f408ad4de24865357 HTTP/1.0" 202 Accepted 2026-04-19 10:37:14,764 - lava_callback - INFO - Starting async job submit for node 69e20d4f408ad4de24865357 2026-04-19 10:37:14,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:37:14,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20d4f408ad4de24865357 HTTP/1.1" 200 None 2026-04-19 10:37:14,781 - lava_callback - DEBUG - Processing node 69e20d4f408ad4de24865357: baseline-arm64-clabbe 2026-04-19 10:37:14,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e20d4f408ad4de24865357 2026-04-19 10:37:14,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:37:14,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e20d4f408ad4de24865357 HTTP/1.1" 200 None 2026-04-19 10:37:14,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:37:14,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-19 10:37:14,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:37:14,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e20d4f408ad4de24865357 HTTP/1.1" 200 None 2026-04-19 10:37:14,835 - lava_callback - ERROR - Error processing callback for node 69e20d4f408ad4de24865357: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:41:48,696 - lava_callback - INFO - Received callback for node 69e4ad457ab9251d5f9174c4 INFO: 172.21.0.1:49646 - "POST /node/69e4ad457ab9251d5f9174c4 HTTP/1.0" 202 Accepted 2026-04-19 10:41:48,703 - lava_callback - INFO - Starting async job submit for node 69e4ad457ab9251d5f9174c4 2026-04-19 10:41:48,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:41:48,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ad457ab9251d5f9174c4 HTTP/1.1" 200 None 2026-04-19 10:41:48,796 - lava_callback - DEBUG - Processing node 69e4ad457ab9251d5f9174c4: baseline-arm 2026-04-19 10:41:49,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:41:49,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:41:49,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e4ad457ab9251d5f9174c4/log.txt.gz 2026-04-19 10:41:49,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:41:50,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:41:50,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e4ad457ab9251d5f9174c4/lava-logs.yaml 2026-04-19 10:41:50,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:41:50,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:41:50,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e4ad457ab9251d5f9174c4/lava_callback.json.gz DEBUG: Setup failed for 69e4ad457ab9251d5f9174c4. Transitting job node result: incomplete -> fail 2026-04-19 10:41:50,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:41:50,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ad457ab9251d5f9174c4 HTTP/1.1" 200 None 2026-04-19 10:41:50,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:41:50,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 10:41:50,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:41:50,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4ad457ab9251d5f9174c4 HTTP/1.1" 200 None 2026-04-19 10:41:50,499 - lava_callback - INFO - Completed processing callback for node 69e4ad457ab9251d5f9174c4 INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:42:00,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:42:00,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37700 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:43:25,797 - lava_callback - INFO - Received callback for node 69e4adf77ab9251d5f9174ee INFO: 172.21.0.1:45690 - "POST /node/69e4adf77ab9251d5f9174ee HTTP/1.0" 202 Accepted 2026-04-19 10:43:25,805 - lava_callback - INFO - Starting async job submit for node 69e4adf77ab9251d5f9174ee 2026-04-19 10:43:25,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:43:25,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4adf77ab9251d5f9174ee HTTP/1.1" 200 None 2026-04-19 10:43:25,864 - lava_callback - DEBUG - Processing node 69e4adf77ab9251d5f9174ee: baseline-x86 INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:43:26,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:43:26,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:43:26,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e4adf77ab9251d5f9174ee/log.txt.gz 2026-04-19 10:43:27,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:43:27,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:43:27,511 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e4adf77ab9251d5f9174ee/lava-logs.yaml 2026-04-19 10:43:27,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:43:27,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:43:27,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e4adf77ab9251d5f9174ee/lava_callback.json.gz DEBUG: Setup failed for 69e4adf77ab9251d5f9174ee. Transitting job node result: incomplete -> fail 2026-04-19 10:43:27,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:43:27,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4adf77ab9251d5f9174ee HTTP/1.1" 200 None 2026-04-19 10:43:27,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:43:27,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f667ab9251d5f915ecc HTTP/1.1" 200 None 2026-04-19 10:43:27,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:43:27,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4adf77ab9251d5f9174ee HTTP/1.1" 200 None 2026-04-19 10:43:27,943 - lava_callback - INFO - Completed processing callback for node 69e4adf77ab9251d5f9174ee 2026-04-19 10:43:30,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:43:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:44:20,565 - lava_callback - INFO - Received callback for node 69e4b0407ab9251d5f9175d2 INFO: 172.21.0.1:42708 - "POST /node/69e4b0407ab9251d5f9175d2 HTTP/1.0" 202 Accepted 2026-04-19 10:44:20,573 - lava_callback - INFO - Starting async job submit for node 69e4b0407ab9251d5f9175d2 2026-04-19 10:44:20,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:44:20,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b0407ab9251d5f9175d2 HTTP/1.1" 200 None 2026-04-19 10:44:20,643 - lava_callback - DEBUG - Processing node 69e4b0407ab9251d5f9175d2: baseline-arm64 2026-04-19 10:44:20,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:44:21,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:44:21,078 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4b0407ab9251d5f9175d2/log.txt.gz 2026-04-19 10:44:21,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:44:21,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:44:21,443 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4b0407ab9251d5f9175d2/lava-logs.yaml 2026-04-19 10:44:21,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:44:21,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:44:21,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4b0407ab9251d5f9175d2/lava_callback.json.gz DEBUG: Setup failed for 69e4b0407ab9251d5f9175d2. Transitting job node result: incomplete -> fail 2026-04-19 10:44:21,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:44:21,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b0407ab9251d5f9175d2 HTTP/1.1" 200 None 2026-04-19 10:44:21,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:44:21,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:44:21,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:44:21,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4b0407ab9251d5f9175d2 HTTP/1.1" 200 None 2026-04-19 10:44:21,794 - lava_callback - INFO - Completed processing callback for node 69e4b0407ab9251d5f9175d2 INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:44:30,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:44:30,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:46:02,948 - lava_callback - INFO - Received callback for node 69e4b2107ab9251d5f91762d INFO: 172.21.0.1:47984 - "POST /node/69e4b2107ab9251d5f91762d HTTP/1.0" 202 Accepted 2026-04-19 10:46:02,954 - lava_callback - INFO - Starting async job submit for node 69e4b2107ab9251d5f91762d 2026-04-19 10:46:02,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:46:02,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b2107ab9251d5f91762d HTTP/1.1" 200 None 2026-04-19 10:46:02,990 - lava_callback - DEBUG - Processing node 69e4b2107ab9251d5f91762d: baseline-x86 2026-04-19 10:46:03,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:46:03,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:46:03,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e4b2107ab9251d5f91762d/log.txt.gz 2026-04-19 10:46:03,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:46:03,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:46:03,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e4b2107ab9251d5f91762d/lava-logs.yaml 2026-04-19 10:46:03,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:46:03,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:46:03,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e4b2107ab9251d5f91762d/lava_callback.json.gz 2026-04-19 10:46:03,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:46:03,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b2107ab9251d5f91762d HTTP/1.1" 200 None 2026-04-19 10:46:03,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:46:03,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f667ab9251d5f915ecc HTTP/1.1" 200 None 2026-04-19 10:46:03,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:46:03,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4b2107ab9251d5f91762d HTTP/1.1" 200 None 2026-04-19 10:46:03,964 - lava_callback - INFO - Completed processing callback for node 69e4b2107ab9251d5f91762d INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:46:30,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:46:30,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:49:01,694 - lava_callback - INFO - Received callback for node 69e4ae4d7ab9251d5f917518 INFO: 172.21.0.1:36588 - "POST /node/69e4ae4d7ab9251d5f917518 HTTP/1.0" 202 Accepted 2026-04-19 10:49:01,700 - lava_callback - INFO - Starting async job submit for node 69e4ae4d7ab9251d5f917518 2026-04-19 10:49:01,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:01,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ae4d7ab9251d5f917518 HTTP/1.1" 200 None 2026-04-19 10:49:01,735 - lava_callback - DEBUG - Processing node 69e4ae4d7ab9251d5f917518: baseline-arm64 2026-04-19 10:49:01,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:49:02,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:49:02,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4ae4d7ab9251d5f917518/log.txt.gz 2026-04-19 10:49:02,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:49:02,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:49:02,317 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4ae4d7ab9251d5f917518/lava-logs.yaml 2026-04-19 10:49:02,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:49:02,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:49:02,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4ae4d7ab9251d5f917518/lava_callback.json.gz DEBUG: Setup failed for 69e4ae4d7ab9251d5f917518. Transitting job node result: incomplete -> fail 2026-04-19 10:49:02,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:02,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ae4d7ab9251d5f917518 HTTP/1.1" 200 None 2026-04-19 10:49:02,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:02,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:49:02,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:02,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4ae4d7ab9251d5f917518 HTTP/1.1" 200 None 2026-04-19 10:49:02,558 - lava_callback - INFO - Completed processing callback for node 69e4ae4d7ab9251d5f917518 INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:49:30,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:30,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:49:56,738 - lava_callback - INFO - Received callback for node 69e4af317ab9251d5f91758e INFO: 172.21.0.1:58330 - "POST /node/69e4af317ab9251d5f91758e HTTP/1.0" 202 Accepted 2026-04-19 10:49:56,745 - lava_callback - INFO - Starting async job submit for node 69e4af317ab9251d5f91758e 2026-04-19 10:49:56,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:56,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4af317ab9251d5f91758e HTTP/1.1" 200 None 2026-04-19 10:49:56,825 - lava_callback - DEBUG - Processing node 69e4af317ab9251d5f91758e: ltp-smoke 2026-04-19 10:49:57,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:49:57,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:49:57,424 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e4af317ab9251d5f91758e/log.txt.gz 2026-04-19 10:49:57,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:49:57,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:49:57,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e4af317ab9251d5f91758e/lava-logs.yaml 2026-04-19 10:49:58,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:49:58,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:49:58,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e4af317ab9251d5f91758e/lava_callback.json.gz 2026-04-19 10:49:58,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:58,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4af317ab9251d5f91758e HTTP/1.1" 200 None 2026-04-19 10:49:58,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:58,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f4e7ab9251d5f915ea5 HTTP/1.1" 200 None 2026-04-19 10:49:58,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:49:58,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4af317ab9251d5f91758e HTTP/1.1" 200 None 2026-04-19 10:49:58,438 - lava_callback - INFO - Completed processing callback for node 69e4af317ab9251d5f91758e 2026-04-19 10:50:00,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:50:00,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:50:51,700 - lava_callback - INFO - Received callback for node 69e4aee67ab9251d5f917567 INFO: 172.21.0.1:42360 - "POST /node/69e4aee67ab9251d5f917567 HTTP/1.0" 202 Accepted 2026-04-19 10:50:51,709 - lava_callback - INFO - Starting async job submit for node 69e4aee67ab9251d5f917567 2026-04-19 10:50:51,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:50:51,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4aee67ab9251d5f917567 HTTP/1.1" 200 None 2026-04-19 10:50:51,767 - lava_callback - DEBUG - Processing node 69e4aee67ab9251d5f917567: baseline-nfs-arm64 2026-04-19 10:50:52,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:50:53,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:50:53,125 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4aee67ab9251d5f917567/log.txt.gz 2026-04-19 10:50:53,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:50:53,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:50:53,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4aee67ab9251d5f917567/lava-logs.yaml 2026-04-19 10:50:53,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:50:54,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:50:54,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4aee67ab9251d5f917567/lava_callback.json.gz DEBUG: Setup failed for 69e4aee67ab9251d5f917567. Transitting job node result: incomplete -> fail 2026-04-19 10:50:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:50:54,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4aee67ab9251d5f917567 HTTP/1.1" 200 None 2026-04-19 10:50:54,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:50:54,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:50:54,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:50:54,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4aee67ab9251d5f917567 HTTP/1.1" 200 None 2026-04-19 10:50:54,412 - lava_callback - INFO - Completed processing callback for node 69e4aee67ab9251d5f917567 INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:51:00,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:51:00,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:53:01,493 - lava_callback - INFO - Received callback for node 69e2110b408ad4de24865513 INFO: 172.21.0.1:57468 - "POST /node/69e2110b408ad4de24865513 HTTP/1.0" 202 Accepted 2026-04-19 10:53:01,498 - lava_callback - INFO - Starting async job submit for node 69e2110b408ad4de24865513 2026-04-19 10:53:01,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:53:01,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2110b408ad4de24865513 HTTP/1.1" 200 None 2026-04-19 10:53:01,518 - lava_callback - DEBUG - Processing node 69e2110b408ad4de24865513: baseline-arm-baylibre 2026-04-19 10:53:01,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2110b408ad4de24865513 2026-04-19 10:53:01,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:53:01,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2110b408ad4de24865513 HTTP/1.1" 200 None 2026-04-19 10:53:01,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:53:01,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:53:01,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:53:01,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2110b408ad4de24865513 HTTP/1.1" 200 None 2026-04-19 10:53:01,578 - lava_callback - ERROR - Error processing callback for node 69e2110b408ad4de24865513: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:53:41,486 - lava_callback - INFO - Received callback for node 69e2112f408ad4de2486551f INFO: 172.21.0.1:44288 - "POST /node/69e2112f408ad4de2486551f HTTP/1.0" 202 Accepted 2026-04-19 10:53:41,492 - lava_callback - INFO - Starting async job submit for node 69e2112f408ad4de2486551f 2026-04-19 10:53:41,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:53:41,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2112f408ad4de2486551f HTTP/1.1" 200 None 2026-04-19 10:53:41,513 - lava_callback - DEBUG - Processing node 69e2112f408ad4de2486551f: baseline-arm-baylibre 2026-04-19 10:53:41,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2112f408ad4de2486551f 2026-04-19 10:53:41,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:53:41,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2112f408ad4de2486551f HTTP/1.1" 200 None 2026-04-19 10:53:41,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:53:41,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:53:41,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:53:41,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2112f408ad4de2486551f HTTP/1.1" 200 None 2026-04-19 10:53:41,566 - lava_callback - ERROR - Error processing callback for node 69e2112f408ad4de2486551f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:54:21,620 - lava_callback - INFO - Received callback for node 69e21153408ad4de2486552a INFO: 172.21.0.1:52500 - "POST /node/69e21153408ad4de2486552a HTTP/1.0" 202 Accepted 2026-04-19 10:54:21,628 - lava_callback - INFO - Starting async job submit for node 69e21153408ad4de2486552a 2026-04-19 10:54:21,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:54:21,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21153408ad4de2486552a HTTP/1.1" 200 None 2026-04-19 10:54:21,645 - lava_callback - DEBUG - Processing node 69e21153408ad4de2486552a: baseline-arm-baylibre 2026-04-19 10:54:21,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21153408ad4de2486552a 2026-04-19 10:54:21,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:54:21,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21153408ad4de2486552a HTTP/1.1" 200 None 2026-04-19 10:54:21,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:54:21,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:54:21,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:54:21,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21153408ad4de2486552a HTTP/1.1" 200 None 2026-04-19 10:54:21,712 - lava_callback - ERROR - Error processing callback for node 69e21153408ad4de2486552a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:55:01,534 - lava_callback - INFO - Received callback for node 69e21177408ad4de24865535 INFO: 172.21.0.1:55754 - "POST /node/69e21177408ad4de24865535 HTTP/1.0" 202 Accepted 2026-04-19 10:55:01,539 - lava_callback - INFO - Starting async job submit for node 69e21177408ad4de24865535 2026-04-19 10:55:01,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:01,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21177408ad4de24865535 HTTP/1.1" 200 None 2026-04-19 10:55:01,555 - lava_callback - DEBUG - Processing node 69e21177408ad4de24865535: baseline-arm-baylibre 2026-04-19 10:55:01,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21177408ad4de24865535 2026-04-19 10:55:01,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:01,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21177408ad4de24865535 HTTP/1.1" 200 None 2026-04-19 10:55:01,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:01,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:55:01,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:01,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21177408ad4de24865535 HTTP/1.1" 200 None 2026-04-19 10:55:01,620 - lava_callback - ERROR - Error processing callback for node 69e21177408ad4de24865535: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:55:31,650 - lava_callback - INFO - Received callback for node 69e4afd37ab9251d5f9175a8 INFO: 172.21.0.1:35752 - "POST /node/69e4afd37ab9251d5f9175a8 HTTP/1.0" 202 Accepted 2026-04-19 10:55:31,659 - lava_callback - INFO - Starting async job submit for node 69e4afd37ab9251d5f9175a8 2026-04-19 10:55:31,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:31,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4afd37ab9251d5f9175a8 HTTP/1.1" 200 None 2026-04-19 10:55:31,704 - lava_callback - DEBUG - Processing node 69e4afd37ab9251d5f9175a8: baseline-nfs-arm64 2026-04-19 10:55:31,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:55:32,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:55:32,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4afd37ab9251d5f9175a8/log.txt.gz 2026-04-19 10:55:32,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:55:32,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:55:32,355 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4afd37ab9251d5f9175a8/lava-logs.yaml 2026-04-19 10:55:32,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:55:32,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:55:32,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4afd37ab9251d5f9175a8/lava_callback.json.gz DEBUG: Setup failed for 69e4afd37ab9251d5f9175a8. Transitting job node result: incomplete -> fail 2026-04-19 10:55:32,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:32,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4afd37ab9251d5f9175a8 HTTP/1.1" 200 None 2026-04-19 10:55:32,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:32,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 10:55:32,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:32,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4afd37ab9251d5f9175a8 HTTP/1.1" 200 None 2026-04-19 10:55:32,594 - lava_callback - INFO - Completed processing callback for node 69e4afd37ab9251d5f9175a8 INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:55:41,769 - lava_callback - INFO - Received callback for node 69e2119b408ad4de24865540 INFO: 172.21.0.1:42110 - "POST /node/69e2119b408ad4de24865540 HTTP/1.0" 202 Accepted 2026-04-19 10:55:41,776 - lava_callback - INFO - Starting async job submit for node 69e2119b408ad4de24865540 2026-04-19 10:55:41,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:41,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2119b408ad4de24865540 HTTP/1.1" 200 None 2026-04-19 10:55:41,791 - lava_callback - DEBUG - Processing node 69e2119b408ad4de24865540: baseline-arm-baylibre 2026-04-19 10:55:41,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2119b408ad4de24865540 2026-04-19 10:55:41,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:41,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2119b408ad4de24865540 HTTP/1.1" 200 None 2026-04-19 10:55:41,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:41,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:55:41,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:55:41,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2119b408ad4de24865540 HTTP/1.1" 200 None 2026-04-19 10:55:41,841 - lava_callback - ERROR - Error processing callback for node 69e2119b408ad4de24865540: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:56:00,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:00,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:56:21,611 - lava_callback - INFO - Received callback for node 69e211c0408ad4de2486554d INFO: 172.21.0.1:38708 - "POST /node/69e211c0408ad4de2486554d HTTP/1.0" 202 Accepted 2026-04-19 10:56:21,617 - lava_callback - INFO - Starting async job submit for node 69e211c0408ad4de2486554d 2026-04-19 10:56:21,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:21,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e211c0408ad4de2486554d HTTP/1.1" 200 None 2026-04-19 10:56:21,635 - lava_callback - DEBUG - Processing node 69e211c0408ad4de2486554d: baseline-arm-baylibre 2026-04-19 10:56:21,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e211c0408ad4de2486554d 2026-04-19 10:56:21,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:21,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e211c0408ad4de2486554d HTTP/1.1" 200 None 2026-04-19 10:56:21,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:21,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:56:21,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:21,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e211c0408ad4de2486554d HTTP/1.1" 200 None 2026-04-19 10:56:21,687 - lava_callback - ERROR - Error processing callback for node 69e211c0408ad4de2486554d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:56:41,600 - lava_callback - INFO - Received callback for node 69e211e5408ad4de24865556 INFO: 172.21.0.1:46354 - "POST /node/69e211e5408ad4de24865556 HTTP/1.0" 202 Accepted 2026-04-19 10:56:41,606 - lava_callback - INFO - Starting async job submit for node 69e211e5408ad4de24865556 2026-04-19 10:56:41,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:41,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e211e5408ad4de24865556 HTTP/1.1" 200 None 2026-04-19 10:56:41,622 - lava_callback - DEBUG - Processing node 69e211e5408ad4de24865556: baseline-arm-baylibre 2026-04-19 10:56:41,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e211e5408ad4de24865556 2026-04-19 10:56:41,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:41,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e211e5408ad4de24865556 HTTP/1.1" 200 None 2026-04-19 10:56:41,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:41,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:56:41,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:56:41,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e211e5408ad4de24865556 HTTP/1.1" 200 None 2026-04-19 10:56:41,671 - lava_callback - ERROR - Error processing callback for node 69e211e5408ad4de24865556: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:57:21,683 - lava_callback - INFO - Received callback for node 69e21207408ad4de24865563 INFO: 172.21.0.1:57814 - "POST /node/69e21207408ad4de24865563 HTTP/1.0" 202 Accepted 2026-04-19 10:57:21,688 - lava_callback - INFO - Starting async job submit for node 69e21207408ad4de24865563 2026-04-19 10:57:21,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:57:21,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21207408ad4de24865563 HTTP/1.1" 200 None 2026-04-19 10:57:21,713 - lava_callback - DEBUG - Processing node 69e21207408ad4de24865563: baseline-arm-baylibre 2026-04-19 10:57:21,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21207408ad4de24865563 2026-04-19 10:57:21,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:57:21,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21207408ad4de24865563 HTTP/1.1" 200 None 2026-04-19 10:57:21,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:57:21,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:57:21,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:57:21,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21207408ad4de24865563 HTTP/1.1" 200 None 2026-04-19 10:57:21,764 - lava_callback - ERROR - Error processing callback for node 69e21207408ad4de24865563: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:58:01,836 - lava_callback - INFO - Received callback for node 69e2122b408ad4de2486556f INFO: 172.21.0.1:37070 - "POST /node/69e2122b408ad4de2486556f HTTP/1.0" 202 Accepted 2026-04-19 10:58:01,845 - lava_callback - INFO - Starting async job submit for node 69e2122b408ad4de2486556f 2026-04-19 10:58:01,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:58:01,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2122b408ad4de2486556f HTTP/1.1" 200 None 2026-04-19 10:58:01,864 - lava_callback - DEBUG - Processing node 69e2122b408ad4de2486556f: baseline-arm-baylibre 2026-04-19 10:58:01,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2122b408ad4de2486556f 2026-04-19 10:58:01,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:58:01,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2122b408ad4de2486556f HTTP/1.1" 200 None 2026-04-19 10:58:01,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:58:01,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:58:01,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:58:01,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2122b408ad4de2486556f HTTP/1.1" 200 None 2026-04-19 10:58:01,932 - lava_callback - ERROR - Error processing callback for node 69e2122b408ad4de2486556f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:58:41,754 - lava_callback - INFO - Received callback for node 69e21251408ad4de2486557d INFO: 172.21.0.1:54882 - "POST /node/69e21251408ad4de2486557d HTTP/1.0" 202 Accepted 2026-04-19 10:58:41,759 - lava_callback - INFO - Starting async job submit for node 69e21251408ad4de2486557d 2026-04-19 10:58:41,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:58:41,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21251408ad4de2486557d HTTP/1.1" 200 None 2026-04-19 10:58:41,776 - lava_callback - DEBUG - Processing node 69e21251408ad4de2486557d: baseline-arm-baylibre 2026-04-19 10:58:41,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21251408ad4de2486557d 2026-04-19 10:58:41,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:58:41,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21251408ad4de2486557d HTTP/1.1" 200 None 2026-04-19 10:58:41,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:58:41,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:58:41,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:58:41,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21251408ad4de2486557d HTTP/1.1" 200 None 2026-04-19 10:58:41,823 - lava_callback - ERROR - Error processing callback for node 69e21251408ad4de2486557d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:59:21,762 - lava_callback - INFO - Received callback for node 69e21275408ad4de2486558a INFO: 172.21.0.1:60268 - "POST /node/69e21275408ad4de2486558a HTTP/1.0" 202 Accepted 2026-04-19 10:59:21,768 - lava_callback - INFO - Starting async job submit for node 69e21275408ad4de2486558a 2026-04-19 10:59:21,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:21,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21275408ad4de2486558a HTTP/1.1" 200 None 2026-04-19 10:59:21,784 - lava_callback - DEBUG - Processing node 69e21275408ad4de2486558a: baseline-arm-baylibre 2026-04-19 10:59:21,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21275408ad4de2486558a 2026-04-19 10:59:21,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:21,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21275408ad4de2486558a HTTP/1.1" 200 None 2026-04-19 10:59:21,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:21,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:59:21,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:21,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21275408ad4de2486558a HTTP/1.1" 200 None 2026-04-19 10:59:21,837 - lava_callback - ERROR - Error processing callback for node 69e21275408ad4de2486558a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:59:30,313 - lava_callback - INFO - Received callback for node 69e4b16f7ab9251d5f917612 INFO: 172.21.0.1:46162 - "POST /node/69e4b16f7ab9251d5f917612 HTTP/1.0" 202 Accepted 2026-04-19 10:59:30,320 - lava_callback - INFO - Starting async job submit for node 69e4b16f7ab9251d5f917612 2026-04-19 10:59:30,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:30,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b16f7ab9251d5f917612 HTTP/1.1" 200 None 2026-04-19 10:59:30,388 - lava_callback - DEBUG - Processing node 69e4b16f7ab9251d5f917612: baseline-arm 2026-04-19 10:59:30,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:59:31,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:59:31,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e4b16f7ab9251d5f917612/log.txt.gz 2026-04-19 10:59:31,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:59:31,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:59:31,710 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e4b16f7ab9251d5f917612/lava-logs.yaml 2026-04-19 10:59:31,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 10:59:31,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 10:59:31,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e4b16f7ab9251d5f917612/lava_callback.json.gz DEBUG: Setup failed for 69e4b16f7ab9251d5f917612. Transitting job node result: incomplete -> fail 2026-04-19 10:59:31,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:32,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b16f7ab9251d5f917612 HTTP/1.1" 200 None 2026-04-19 10:59:32,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:32,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-19 10:59:32,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:32,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4b16f7ab9251d5f917612 HTTP/1.1" 200 None 2026-04-19 10:59:32,165 - lava_callback - INFO - Completed processing callback for node 69e4b16f7ab9251d5f917612 INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK 2026-04-19 10:59:55,761 - lava_callback - INFO - Received callback for node 69e2129b408ad4de24865596 INFO: 172.21.0.1:57588 - "POST /node/69e2129b408ad4de24865596 HTTP/1.0" 202 Accepted 2026-04-19 10:59:55,766 - lava_callback - INFO - Starting async job submit for node 69e2129b408ad4de24865596 2026-04-19 10:59:55,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:55,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2129b408ad4de24865596 HTTP/1.1" 200 None 2026-04-19 10:59:55,783 - lava_callback - DEBUG - Processing node 69e2129b408ad4de24865596: baseline-arm-clabbe 2026-04-19 10:59:55,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2129b408ad4de24865596 2026-04-19 10:59:55,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:55,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2129b408ad4de24865596 HTTP/1.1" 200 None 2026-04-19 10:59:55,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:55,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 10:59:55,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 10:59:55,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2129b408ad4de24865596 HTTP/1.1" 200 None 2026-04-19 10:59:55,839 - lava_callback - ERROR - Error processing callback for node 69e2129b408ad4de24865596: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:00:00,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:00:00,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:00:35,726 - lava_callback - INFO - Received callback for node 69e212c5408ad4de248655a1 INFO: 172.21.0.1:42916 - "POST /node/69e212c5408ad4de248655a1 HTTP/1.0" 202 Accepted 2026-04-19 11:00:35,732 - lava_callback - INFO - Starting async job submit for node 69e212c5408ad4de248655a1 2026-04-19 11:00:35,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:00:35,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e212c5408ad4de248655a1 HTTP/1.1" 200 None 2026-04-19 11:00:35,749 - lava_callback - DEBUG - Processing node 69e212c5408ad4de248655a1: baseline-arm-clabbe 2026-04-19 11:00:35,749 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e212c5408ad4de248655a1 2026-04-19 11:00:35,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:00:35,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e212c5408ad4de248655a1 HTTP/1.1" 200 None 2026-04-19 11:00:35,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:00:35,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:00:35,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:00:35,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e212c5408ad4de248655a1 HTTP/1.1" 200 None 2026-04-19 11:00:35,810 - lava_callback - ERROR - Error processing callback for node 69e212c5408ad4de248655a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 11:01:15,777 - lava_callback - INFO - Received callback for node 69e212ea408ad4de248655ac INFO: 172.21.0.1:39200 - "POST /node/69e212ea408ad4de248655ac HTTP/1.0" 202 Accepted 2026-04-19 11:01:15,783 - lava_callback - INFO - Starting async job submit for node 69e212ea408ad4de248655ac 2026-04-19 11:01:15,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:01:15,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e212ea408ad4de248655ac HTTP/1.1" 200 None 2026-04-19 11:01:15,799 - lava_callback - DEBUG - Processing node 69e212ea408ad4de248655ac: baseline-arm-clabbe 2026-04-19 11:01:15,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e212ea408ad4de248655ac 2026-04-19 11:01:15,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:01:15,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e212ea408ad4de248655ac HTTP/1.1" 200 None 2026-04-19 11:01:15,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:01:15,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:01:15,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:01:15,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e212ea408ad4de248655ac HTTP/1.1" 200 None 2026-04-19 11:01:15,846 - lava_callback - ERROR - Error processing callback for node 69e212ea408ad4de248655ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:01:41,923 - lava_callback - INFO - Received callback for node 69e2130e408ad4de248655bb INFO: 172.21.0.1:37798 - "POST /node/69e2130e408ad4de248655bb HTTP/1.0" 202 Accepted 2026-04-19 11:01:41,929 - lava_callback - INFO - Starting async job submit for node 69e2130e408ad4de248655bb 2026-04-19 11:01:41,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:01:41,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2130e408ad4de248655bb HTTP/1.1" 200 None 2026-04-19 11:01:41,944 - lava_callback - DEBUG - Processing node 69e2130e408ad4de248655bb: baseline-arm-baylibre 2026-04-19 11:01:41,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2130e408ad4de248655bb 2026-04-19 11:01:41,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:01:41,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2130e408ad4de248655bb HTTP/1.1" 200 None 2026-04-19 11:01:41,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:01:41,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:01:41,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:01:42,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2130e408ad4de248655bb HTTP/1.1" 200 None 2026-04-19 11:01:42,006 - lava_callback - ERROR - Error processing callback for node 69e2130e408ad4de248655bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:02:35,866 - lava_callback - INFO - Received callback for node 69e2133e408ad4de248655c8 INFO: 172.21.0.1:46336 - "POST /node/69e2133e408ad4de248655c8 HTTP/1.0" 202 Accepted 2026-04-19 11:02:35,872 - lava_callback - INFO - Starting async job submit for node 69e2133e408ad4de248655c8 2026-04-19 11:02:35,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:02:35,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2133e408ad4de248655c8 HTTP/1.1" 200 None 2026-04-19 11:02:35,888 - lava_callback - DEBUG - Processing node 69e2133e408ad4de248655c8: baseline-arm-clabbe 2026-04-19 11:02:35,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2133e408ad4de248655c8 2026-04-19 11:02:35,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:02:35,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2133e408ad4de248655c8 HTTP/1.1" 200 None 2026-04-19 11:02:35,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:02:35,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:02:35,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:02:35,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2133e408ad4de248655c8 HTTP/1.1" 200 None 2026-04-19 11:02:35,937 - lava_callback - ERROR - Error processing callback for node 69e2133e408ad4de248655c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 11:03:15,835 - lava_callback - INFO - Received callback for node 69e21364408ad4de248655d5 INFO: 172.21.0.1:43542 - "POST /node/69e21364408ad4de248655d5 HTTP/1.0" 202 Accepted 2026-04-19 11:03:15,843 - lava_callback - INFO - Starting async job submit for node 69e21364408ad4de248655d5 2026-04-19 11:03:15,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:03:15,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21364408ad4de248655d5 HTTP/1.1" 200 None 2026-04-19 11:03:15,860 - lava_callback - DEBUG - Processing node 69e21364408ad4de248655d5: baseline-arm-clabbe 2026-04-19 11:03:15,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21364408ad4de248655d5 2026-04-19 11:03:15,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:03:15,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21364408ad4de248655d5 HTTP/1.1" 200 None 2026-04-19 11:03:15,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:03:15,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:03:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:03:15,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21364408ad4de248655d5 HTTP/1.1" 200 None 2026-04-19 11:03:15,917 - lava_callback - ERROR - Error processing callback for node 69e21364408ad4de248655d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:03:55,872 - lava_callback - INFO - Received callback for node 69e21389408ad4de248655e2 INFO: 172.21.0.1:49668 - "POST /node/69e21389408ad4de248655e2 HTTP/1.0" 202 Accepted 2026-04-19 11:03:55,877 - lava_callback - INFO - Starting async job submit for node 69e21389408ad4de248655e2 2026-04-19 11:03:55,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:03:55,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21389408ad4de248655e2 HTTP/1.1" 200 None 2026-04-19 11:03:55,893 - lava_callback - DEBUG - Processing node 69e21389408ad4de248655e2: baseline-arm-clabbe 2026-04-19 11:03:55,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21389408ad4de248655e2 2026-04-19 11:03:55,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:03:55,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21389408ad4de248655e2 HTTP/1.1" 200 None 2026-04-19 11:03:55,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:03:55,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:03:55,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:03:55,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21389408ad4de248655e2 HTTP/1.1" 200 None 2026-04-19 11:03:55,946 - lava_callback - ERROR - Error processing callback for node 69e21389408ad4de248655e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:04:35,875 - lava_callback - INFO - Received callback for node 69e213b0408ad4de248655ef INFO: 172.21.0.1:58630 - "POST /node/69e213b0408ad4de248655ef HTTP/1.0" 202 Accepted 2026-04-19 11:04:35,881 - lava_callback - INFO - Starting async job submit for node 69e213b0408ad4de248655ef 2026-04-19 11:04:35,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:04:35,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e213b0408ad4de248655ef HTTP/1.1" 200 None 2026-04-19 11:04:35,897 - lava_callback - DEBUG - Processing node 69e213b0408ad4de248655ef: baseline-arm-clabbe 2026-04-19 11:04:35,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e213b0408ad4de248655ef 2026-04-19 11:04:35,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:04:35,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e213b0408ad4de248655ef HTTP/1.1" 200 None 2026-04-19 11:04:35,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:04:35,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:04:35,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:04:35,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e213b0408ad4de248655ef HTTP/1.1" 200 None 2026-04-19 11:04:35,952 - lava_callback - ERROR - Error processing callback for node 69e213b0408ad4de248655ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43870 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 11:05:15,960 - lava_callback - INFO - Received callback for node 69e213d5408ad4de248655fb INFO: 172.21.0.1:43874 - "POST /node/69e213d5408ad4de248655fb HTTP/1.0" 202 Accepted 2026-04-19 11:05:15,966 - lava_callback - INFO - Starting async job submit for node 69e213d5408ad4de248655fb 2026-04-19 11:05:15,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:05:16,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e213d5408ad4de248655fb HTTP/1.1" 200 None 2026-04-19 11:05:16,021 - lava_callback - DEBUG - Processing node 69e213d5408ad4de248655fb: baseline-arm-clabbe 2026-04-19 11:05:16,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e213d5408ad4de248655fb 2026-04-19 11:05:16,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:05:16,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e213d5408ad4de248655fb HTTP/1.1" 200 None 2026-04-19 11:05:16,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:05:16,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:05:16,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:05:16,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e213d5408ad4de248655fb HTTP/1.1" 200 None 2026-04-19 11:05:16,166 - lava_callback - ERROR - Error processing callback for node 69e213d5408ad4de248655fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:05:35,923 - lava_callback - INFO - Received callback for node 69e213fa408ad4de2486560b INFO: 172.21.0.1:33734 - "POST /node/69e213fa408ad4de2486560b HTTP/1.0" 202 Accepted 2026-04-19 11:05:35,931 - lava_callback - INFO - Starting async job submit for node 69e213fa408ad4de2486560b 2026-04-19 11:05:35,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:05:35,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e213fa408ad4de2486560b HTTP/1.1" 200 None 2026-04-19 11:05:35,947 - lava_callback - DEBUG - Processing node 69e213fa408ad4de2486560b: baseline-arm-clabbe 2026-04-19 11:05:35,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e213fa408ad4de2486560b 2026-04-19 11:05:35,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:05:35,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e213fa408ad4de2486560b HTTP/1.1" 200 None 2026-04-19 11:05:35,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:05:35,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:05:35,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:05:36,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e213fa408ad4de2486560b HTTP/1.1" 200 None 2026-04-19 11:05:36,016 - lava_callback - ERROR - Error processing callback for node 69e213fa408ad4de2486560b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 11:06:16,031 - lava_callback - INFO - Received callback for node 69e21420408ad4de24865616 INFO: 172.21.0.1:37718 - "POST /node/69e21420408ad4de24865616 HTTP/1.0" 202 Accepted 2026-04-19 11:06:16,037 - lava_callback - INFO - Starting async job submit for node 69e21420408ad4de24865616 2026-04-19 11:06:16,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:06:16,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21420408ad4de24865616 HTTP/1.1" 200 None 2026-04-19 11:06:16,053 - lava_callback - DEBUG - Processing node 69e21420408ad4de24865616: baseline-arm-clabbe 2026-04-19 11:06:16,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21420408ad4de24865616 2026-04-19 11:06:16,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:06:16,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21420408ad4de24865616 HTTP/1.1" 200 None 2026-04-19 11:06:16,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:06:16,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:06:16,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:06:16,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21420408ad4de24865616 HTTP/1.1" 200 None 2026-04-19 11:06:16,114 - lava_callback - ERROR - Error processing callback for node 69e21420408ad4de24865616: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:06:56,004 - lava_callback - INFO - Received callback for node 69e21444408ad4de24865622 INFO: 172.21.0.1:42874 - "POST /node/69e21444408ad4de24865622 HTTP/1.0" 202 Accepted 2026-04-19 11:06:56,009 - lava_callback - INFO - Starting async job submit for node 69e21444408ad4de24865622 2026-04-19 11:06:56,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:06:56,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21444408ad4de24865622 HTTP/1.1" 200 None 2026-04-19 11:06:56,026 - lava_callback - DEBUG - Processing node 69e21444408ad4de24865622: baseline-arm-clabbe 2026-04-19 11:06:56,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21444408ad4de24865622 2026-04-19 11:06:56,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:06:56,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21444408ad4de24865622 HTTP/1.1" 200 None 2026-04-19 11:06:56,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:06:56,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:06:56,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:06:56,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21444408ad4de24865622 HTTP/1.1" 200 None 2026-04-19 11:06:56,080 - lava_callback - ERROR - Error processing callback for node 69e21444408ad4de24865622: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:07:36,074 - lava_callback - INFO - Received callback for node 69e2146a408ad4de24865630 INFO: 172.21.0.1:40226 - "POST /node/69e2146a408ad4de24865630 HTTP/1.0" 202 Accepted 2026-04-19 11:07:36,080 - lava_callback - INFO - Starting async job submit for node 69e2146a408ad4de24865630 2026-04-19 11:07:36,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:07:36,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2146a408ad4de24865630 HTTP/1.1" 200 None 2026-04-19 11:07:36,099 - lava_callback - DEBUG - Processing node 69e2146a408ad4de24865630: baseline-arm-clabbe 2026-04-19 11:07:36,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2146a408ad4de24865630 2026-04-19 11:07:36,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:07:36,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2146a408ad4de24865630 HTTP/1.1" 200 None 2026-04-19 11:07:36,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:07:36,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:07:36,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:07:36,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2146a408ad4de24865630 HTTP/1.1" 200 None 2026-04-19 11:07:36,165 - lava_callback - ERROR - Error processing callback for node 69e2146a408ad4de24865630: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 11:08:16,045 - lava_callback - INFO - Received callback for node 69e2148f408ad4de2486563d INFO: 172.21.0.1:44016 - "POST /node/69e2148f408ad4de2486563d HTTP/1.0" 202 Accepted 2026-04-19 11:08:16,051 - lava_callback - INFO - Starting async job submit for node 69e2148f408ad4de2486563d 2026-04-19 11:08:16,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:08:16,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2148f408ad4de2486563d HTTP/1.1" 200 None 2026-04-19 11:08:16,066 - lava_callback - DEBUG - Processing node 69e2148f408ad4de2486563d: baseline-arm-clabbe 2026-04-19 11:08:16,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2148f408ad4de2486563d 2026-04-19 11:08:16,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:08:16,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2148f408ad4de2486563d HTTP/1.1" 200 None 2026-04-19 11:08:16,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:08:16,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:08:16,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:08:16,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2148f408ad4de2486563d HTTP/1.1" 200 None 2026-04-19 11:08:16,120 - lava_callback - ERROR - Error processing callback for node 69e2148f408ad4de2486563d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:08:56,128 - lava_callback - INFO - Received callback for node 69e214b4408ad4de24865647 INFO: 172.21.0.1:59342 - "POST /node/69e214b4408ad4de24865647 HTTP/1.0" 202 Accepted 2026-04-19 11:08:56,133 - lava_callback - INFO - Starting async job submit for node 69e214b4408ad4de24865647 2026-04-19 11:08:56,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:08:56,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e214b4408ad4de24865647 HTTP/1.1" 200 None 2026-04-19 11:08:56,156 - lava_callback - DEBUG - Processing node 69e214b4408ad4de24865647: baseline-arm-clabbe 2026-04-19 11:08:56,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e214b4408ad4de24865647 2026-04-19 11:08:56,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:08:56,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e214b4408ad4de24865647 HTTP/1.1" 200 None 2026-04-19 11:08:56,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:08:56,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:08:56,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:08:56,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e214b4408ad4de24865647 HTTP/1.1" 200 None 2026-04-19 11:08:56,202 - lava_callback - ERROR - Error processing callback for node 69e214b4408ad4de24865647: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:09:36,110 - lava_callback - INFO - Received callback for node 69e214d9408ad4de24865653 INFO: 172.21.0.1:51750 - "POST /node/69e214d9408ad4de24865653 HTTP/1.0" 202 Accepted 2026-04-19 11:09:36,115 - lava_callback - INFO - Starting async job submit for node 69e214d9408ad4de24865653 2026-04-19 11:09:36,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:09:36,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e214d9408ad4de24865653 HTTP/1.1" 200 None 2026-04-19 11:09:36,132 - lava_callback - DEBUG - Processing node 69e214d9408ad4de24865653: baseline-arm-clabbe 2026-04-19 11:09:36,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e214d9408ad4de24865653 2026-04-19 11:09:36,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:09:36,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e214d9408ad4de24865653 HTTP/1.1" 200 None 2026-04-19 11:09:36,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:09:36,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:09:36,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:09:36,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e214d9408ad4de24865653 HTTP/1.1" 200 None 2026-04-19 11:09:36,189 - lava_callback - ERROR - Error processing callback for node 69e214d9408ad4de24865653: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:09:56,145 - lava_callback - INFO - Received callback for node 69e214ff408ad4de2486565f INFO: 172.21.0.1:37780 - "POST /node/69e214ff408ad4de2486565f HTTP/1.0" 202 Accepted 2026-04-19 11:09:56,151 - lava_callback - INFO - Starting async job submit for node 69e214ff408ad4de2486565f 2026-04-19 11:09:56,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:09:56,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e214ff408ad4de2486565f HTTP/1.1" 200 None 2026-04-19 11:09:56,170 - lava_callback - DEBUG - Processing node 69e214ff408ad4de2486565f: baseline-arm-clabbe 2026-04-19 11:09:56,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e214ff408ad4de2486565f 2026-04-19 11:09:56,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:09:56,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e214ff408ad4de2486565f HTTP/1.1" 200 None 2026-04-19 11:09:56,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:09:56,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:09:56,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:09:56,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e214ff408ad4de2486565f HTTP/1.1" 200 None 2026-04-19 11:09:56,219 - lava_callback - ERROR - Error processing callback for node 69e214ff408ad4de2486565f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:10:36,156 - lava_callback - INFO - Received callback for node 69e21527408ad4de2486566f INFO: 172.21.0.1:36380 - "POST /node/69e21527408ad4de2486566f HTTP/1.0" 202 Accepted 2026-04-19 11:10:36,162 - lava_callback - INFO - Starting async job submit for node 69e21527408ad4de2486566f 2026-04-19 11:10:36,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:10:36,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21527408ad4de2486566f HTTP/1.1" 200 None 2026-04-19 11:10:36,198 - lava_callback - DEBUG - Processing node 69e21527408ad4de2486566f: baseline-arm-clabbe 2026-04-19 11:10:36,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21527408ad4de2486566f 2026-04-19 11:10:36,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:10:36,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21527408ad4de2486566f HTTP/1.1" 200 None 2026-04-19 11:10:36,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:10:36,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:10:36,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:10:36,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21527408ad4de2486566f HTTP/1.1" 200 None 2026-04-19 11:10:36,250 - lava_callback - ERROR - Error processing callback for node 69e21527408ad4de2486566f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 11:11:16,193 - lava_callback - INFO - Received callback for node 69e2154c408ad4de24865680 INFO: 172.21.0.1:36560 - "POST /node/69e2154c408ad4de24865680 HTTP/1.0" 202 Accepted 2026-04-19 11:11:16,202 - lava_callback - INFO - Starting async job submit for node 69e2154c408ad4de24865680 2026-04-19 11:11:16,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:11:16,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2154c408ad4de24865680 HTTP/1.1" 200 None 2026-04-19 11:11:16,219 - lava_callback - DEBUG - Processing node 69e2154c408ad4de24865680: baseline-arm-clabbe 2026-04-19 11:11:16,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2154c408ad4de24865680 2026-04-19 11:11:16,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:11:16,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2154c408ad4de24865680 HTTP/1.1" 200 None 2026-04-19 11:11:16,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:11:16,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-19 11:11:16,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:11:16,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2154c408ad4de24865680 HTTP/1.1" 200 None 2026-04-19 11:11:16,272 - lava_callback - ERROR - Error processing callback for node 69e2154c408ad4de24865680: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:12:34,755 - lava_callback - INFO - Received callback for node 69e4b3f47ab9251d5f9176f8 INFO: 172.21.0.1:53982 - "POST /node/69e4b3f47ab9251d5f9176f8 HTTP/1.0" 202 Accepted 2026-04-19 11:12:34,763 - lava_callback - INFO - Starting async job submit for node 69e4b3f47ab9251d5f9176f8 2026-04-19 11:12:34,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:12:34,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b3f47ab9251d5f9176f8 HTTP/1.1" 200 None 2026-04-19 11:12:34,827 - lava_callback - DEBUG - Processing node 69e4b3f47ab9251d5f9176f8: baseline-nfs-arm64 2026-04-19 11:12:35,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:12:36,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:12:36,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4b3f47ab9251d5f9176f8/log.txt.gz INFO: 172.21.0.1:53988 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:12:36,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:12:37,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:12:37,039 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4b3f47ab9251d5f9176f8/lava-logs.yaml 2026-04-19 11:12:37,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:12:37,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:12:37,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4b3f47ab9251d5f9176f8/lava_callback.json.gz DEBUG: Setup failed for 69e4b3f47ab9251d5f9176f8. Transitting job node result: incomplete -> fail 2026-04-19 11:12:37,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:12:37,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b3f47ab9251d5f9176f8 HTTP/1.1" 200 None 2026-04-19 11:12:37,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:12:37,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 11:12:37,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:12:37,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4b3f47ab9251d5f9176f8 HTTP/1.1" 200 None 2026-04-19 11:12:37,425 - lava_callback - INFO - Completed processing callback for node 69e4b3f47ab9251d5f9176f8 INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:13:00,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:13:00,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:13:23,157 - lava_callback - INFO - Received callback for node 69e4b3557ab9251d5f9176aa INFO: 172.21.0.1:36058 - "POST /node/69e4b3557ab9251d5f9176aa HTTP/1.0" 202 Accepted 2026-04-19 11:13:23,163 - lava_callback - INFO - Starting async job submit for node 69e4b3557ab9251d5f9176aa 2026-04-19 11:13:23,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:13:23,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b3557ab9251d5f9176aa HTTP/1.1" 200 None 2026-04-19 11:13:23,202 - lava_callback - DEBUG - Processing node 69e4b3557ab9251d5f9176aa: baseline-arm64 2026-04-19 11:13:23,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:13:23,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:13:23,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4b3557ab9251d5f9176aa/log.txt.gz 2026-04-19 11:13:23,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:13:23,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:13:23,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4b3557ab9251d5f9176aa/lava-logs.yaml 2026-04-19 11:13:23,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:13:23,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:13:23,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e4b3557ab9251d5f9176aa/lava_callback.json.gz DEBUG: Setup failed for 69e4b3557ab9251d5f9176aa. Transitting job node result: incomplete -> fail 2026-04-19 11:13:23,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:13:23,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b3557ab9251d5f9176aa HTTP/1.1" 200 None 2026-04-19 11:13:23,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:13:23,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 11:13:23,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:13:23,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4b3557ab9251d5f9176aa HTTP/1.1" 200 None 2026-04-19 11:13:24,008 - lava_callback - INFO - Completed processing callback for node 69e4b3557ab9251d5f9176aa INFO: 172.21.0.1:36068 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:13:30,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:13:30,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:19:52,868 - lava_callback - INFO - Received callback for node 69e4b5227ab9251d5f91777a INFO: 172.21.0.1:37552 - "POST /node/69e4b5227ab9251d5f91777a HTTP/1.0" 202 Accepted 2026-04-19 11:19:52,877 - lava_callback - INFO - Starting async job submit for node 69e4b5227ab9251d5f91777a 2026-04-19 11:19:52,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:19:52,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b5227ab9251d5f91777a HTTP/1.1" 200 None 2026-04-19 11:19:52,924 - lava_callback - DEBUG - Processing node 69e4b5227ab9251d5f91777a: baseline-nfs-arm64 2026-04-19 11:19:53,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:19:53,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:19:53,275 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4b5227ab9251d5f91777a/log.txt.gz 2026-04-19 11:19:53,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:19:53,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:19:53,528 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4b5227ab9251d5f91777a/lava-logs.yaml 2026-04-19 11:19:53,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:19:53,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:19:53,633 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4b5227ab9251d5f91777a/lava_callback.json.gz DEBUG: Setup failed for 69e4b5227ab9251d5f91777a. Transitting job node result: incomplete -> fail 2026-04-19 11:19:53,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:19:53,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4b5227ab9251d5f91777a HTTP/1.1" 200 None 2026-04-19 11:19:53,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:19:53,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 11:19:53,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:19:53,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4b5227ab9251d5f91777a HTTP/1.1" 200 None 2026-04-19 11:19:53,797 - lava_callback - INFO - Completed processing callback for node 69e4b5227ab9251d5f91777a INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:20:00,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:20:00,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:20:43,061 - lava_callback - INFO - Received callback for node 69e21776408ad4de24865760 INFO: 172.21.0.1:47400 - "POST /node/69e21776408ad4de24865760 HTTP/1.0" 202 Accepted 2026-04-19 11:20:43,066 - lava_callback - INFO - Starting async job submit for node 69e21776408ad4de24865760 2026-04-19 11:20:43,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:20:43,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21776408ad4de24865760 HTTP/1.1" 200 None 2026-04-19 11:20:43,085 - lava_callback - DEBUG - Processing node 69e21776408ad4de24865760: baseline-arm64-baylibre 2026-04-19 11:20:43,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21776408ad4de24865760 2026-04-19 11:20:43,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:20:43,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21776408ad4de24865760 HTTP/1.1" 200 None 2026-04-19 11:20:43,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:20:43,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:20:43,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:20:43,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21776408ad4de24865760 HTTP/1.1" 200 None 2026-04-19 11:20:43,136 - lava_callback - ERROR - Error processing callback for node 69e21776408ad4de24865760: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:24:23,417 - lava_callback - INFO - Received callback for node 69e2185c408ad4de248657b6 INFO: 172.21.0.1:53028 - "POST /node/69e2185c408ad4de248657b6 HTTP/1.0" 202 Accepted 2026-04-19 11:24:23,422 - lava_callback - INFO - Starting async job submit for node 69e2185c408ad4de248657b6 2026-04-19 11:24:23,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:24:23,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2185c408ad4de248657b6 HTTP/1.1" 200 None 2026-04-19 11:24:23,443 - lava_callback - DEBUG - Processing node 69e2185c408ad4de248657b6: baseline-arm64-baylibre 2026-04-19 11:24:23,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2185c408ad4de248657b6 2026-04-19 11:24:23,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:24:23,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2185c408ad4de248657b6 HTTP/1.1" 200 None 2026-04-19 11:24:23,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:24:23,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:24:23,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:24:23,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2185c408ad4de248657b6 HTTP/1.1" 200 None 2026-04-19 11:24:23,491 - lava_callback - ERROR - Error processing callback for node 69e2185c408ad4de248657b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:25:43,369 - lava_callback - INFO - Received callback for node 69e218aa408ad4de248657dc INFO: 172.21.0.1:45302 - "POST /node/69e218aa408ad4de248657dc HTTP/1.0" 202 Accepted 2026-04-19 11:25:43,374 - lava_callback - INFO - Starting async job submit for node 69e218aa408ad4de248657dc 2026-04-19 11:25:43,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:25:43,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e218aa408ad4de248657dc HTTP/1.1" 200 None 2026-04-19 11:25:43,389 - lava_callback - DEBUG - Processing node 69e218aa408ad4de248657dc: baseline-arm64-baylibre 2026-04-19 11:25:43,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e218aa408ad4de248657dc 2026-04-19 11:25:43,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:25:43,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e218aa408ad4de248657dc HTTP/1.1" 200 None 2026-04-19 11:25:43,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:25:43,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:25:43,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:25:43,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e218aa408ad4de248657dc HTTP/1.1" 200 None 2026-04-19 11:25:43,445 - lava_callback - ERROR - Error processing callback for node 69e218aa408ad4de248657dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:27:03,334 - lava_callback - INFO - Received callback for node 69e218f6408ad4de248657f3 INFO: 172.21.0.1:50024 - "POST /node/69e218f6408ad4de248657f3 HTTP/1.0" 202 Accepted 2026-04-19 11:27:03,340 - lava_callback - INFO - Starting async job submit for node 69e218f6408ad4de248657f3 2026-04-19 11:27:03,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:27:03,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e218f6408ad4de248657f3 HTTP/1.1" 200 None 2026-04-19 11:27:03,355 - lava_callback - DEBUG - Processing node 69e218f6408ad4de248657f3: baseline-arm64-baylibre 2026-04-19 11:27:03,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e218f6408ad4de248657f3 2026-04-19 11:27:03,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:27:03,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e218f6408ad4de248657f3 HTTP/1.1" 200 None 2026-04-19 11:27:03,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:27:03,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:27:03,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:27:03,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e218f6408ad4de248657f3 HTTP/1.1" 200 None 2026-04-19 11:27:03,403 - lava_callback - ERROR - Error processing callback for node 69e218f6408ad4de248657f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59872 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:29:36,981 - lava_callback - INFO - Received callback for node 69e21995408ad4de2486583f INFO: 172.21.0.1:59882 - "POST /node/69e21995408ad4de2486583f HTTP/1.0" 202 Accepted 2026-04-19 11:29:36,987 - lava_callback - INFO - Starting async job submit for node 69e21995408ad4de2486583f 2026-04-19 11:29:36,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:29:37,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21995408ad4de2486583f HTTP/1.1" 200 None 2026-04-19 11:29:37,008 - lava_callback - DEBUG - Processing node 69e21995408ad4de2486583f: baseline-arm64-clabbe 2026-04-19 11:29:37,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21995408ad4de2486583f 2026-04-19 11:29:37,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:29:37,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21995408ad4de2486583f HTTP/1.1" 200 None 2026-04-19 11:29:37,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:29:37,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:29:37,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:29:37,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21995408ad4de2486583f HTTP/1.1" 200 None 2026-04-19 11:29:37,064 - lava_callback - ERROR - Error processing callback for node 69e21995408ad4de2486583f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:30:57,200 - lava_callback - INFO - Received callback for node 69e219e3408ad4de24865863 INFO: 172.21.0.1:45548 - "POST /node/69e219e3408ad4de24865863 HTTP/1.0" 202 Accepted 2026-04-19 11:30:57,206 - lava_callback - INFO - Starting async job submit for node 69e219e3408ad4de24865863 2026-04-19 11:30:57,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:30:57,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e219e3408ad4de24865863 HTTP/1.1" 200 None 2026-04-19 11:30:57,221 - lava_callback - DEBUG - Processing node 69e219e3408ad4de24865863: baseline-arm64-clabbe 2026-04-19 11:30:57,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e219e3408ad4de24865863 2026-04-19 11:30:57,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:30:57,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e219e3408ad4de24865863 HTTP/1.1" 200 None 2026-04-19 11:30:57,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:30:57,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:30:57,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:30:57,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e219e3408ad4de24865863 HTTP/1.1" 200 None 2026-04-19 11:30:57,275 - lava_callback - ERROR - Error processing callback for node 69e219e3408ad4de24865863: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:31:55,590 - lava_callback - INFO - Received callback for node 69e4a9ca7ab9251d5f917313 INFO: 172.21.0.1:38246 - "POST /node/69e4a9ca7ab9251d5f917313 HTTP/1.0" 202 Accepted 2026-04-19 11:31:55,597 - lava_callback - INFO - Starting async job submit for node 69e4a9ca7ab9251d5f917313 2026-04-19 11:31:55,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:31:55,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a9ca7ab9251d5f917313 HTTP/1.1" 200 None 2026-04-19 11:31:55,646 - lava_callback - DEBUG - Processing node 69e4a9ca7ab9251d5f917313: baseline-nfs-arm64 2026-04-19 11:31:56,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:31:56,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:31:56,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a9ca7ab9251d5f917313/log.txt.gz INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:31:56,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:31:56,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:31:56,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a9ca7ab9251d5f917313/lava-logs.yaml 2026-04-19 11:31:56,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:31:56,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:31:56,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e4a9ca7ab9251d5f917313/lava_callback.json.gz 2026-04-19 11:31:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:31:56,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4a9ca7ab9251d5f917313 HTTP/1.1" 200 None 2026-04-19 11:31:56,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:31:56,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 11:31:56,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:31:56,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4a9ca7ab9251d5f917313 HTTP/1.1" 200 None 2026-04-19 11:31:57,029 - lava_callback - INFO - Completed processing callback for node 69e4a9ca7ab9251d5f917313 2026-04-19 11:32:00,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:32:00,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:32:17,079 - lava_callback - INFO - Received callback for node 69e21a31408ad4de2486588b INFO: 172.21.0.1:36190 - "POST /node/69e21a31408ad4de2486588b HTTP/1.0" 202 Accepted 2026-04-19 11:32:17,089 - lava_callback - INFO - Starting async job submit for node 69e21a31408ad4de2486588b 2026-04-19 11:32:17,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:32:17,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21a31408ad4de2486588b HTTP/1.1" 200 None 2026-04-19 11:32:17,106 - lava_callback - DEBUG - Processing node 69e21a31408ad4de2486588b: baseline-arm64-clabbe 2026-04-19 11:32:17,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21a31408ad4de2486588b 2026-04-19 11:32:17,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:32:17,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21a31408ad4de2486588b HTTP/1.1" 200 None 2026-04-19 11:32:17,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:32:17,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:32:17,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:32:17,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21a31408ad4de2486588b HTTP/1.1" 200 None 2026-04-19 11:32:17,162 - lava_callback - ERROR - Error processing callback for node 69e21a31408ad4de2486588b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:33:37,134 - lava_callback - INFO - Received callback for node 69e21a7f408ad4de248658a0 INFO: 172.21.0.1:48836 - "POST /node/69e21a7f408ad4de248658a0 HTTP/1.0" 202 Accepted 2026-04-19 11:33:37,139 - lava_callback - INFO - Starting async job submit for node 69e21a7f408ad4de248658a0 2026-04-19 11:33:37,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:33:37,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21a7f408ad4de248658a0 HTTP/1.1" 200 None 2026-04-19 11:33:37,155 - lava_callback - DEBUG - Processing node 69e21a7f408ad4de248658a0: baseline-arm64-clabbe 2026-04-19 11:33:37,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21a7f408ad4de248658a0 2026-04-19 11:33:37,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:33:37,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21a7f408ad4de248658a0 HTTP/1.1" 200 None 2026-04-19 11:33:37,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:33:37,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:33:37,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:33:37,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21a7f408ad4de248658a0 HTTP/1.1" 200 None 2026-04-19 11:33:37,209 - lava_callback - ERROR - Error processing callback for node 69e21a7f408ad4de248658a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:34:57,243 - lava_callback - INFO - Received callback for node 69e21acd408ad4de248658c4 INFO: 172.21.0.1:54266 - "POST /node/69e21acd408ad4de248658c4 HTTP/1.0" 202 Accepted 2026-04-19 11:34:57,249 - lava_callback - INFO - Starting async job submit for node 69e21acd408ad4de248658c4 2026-04-19 11:34:57,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:34:57,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21acd408ad4de248658c4 HTTP/1.1" 200 None 2026-04-19 11:34:57,270 - lava_callback - DEBUG - Processing node 69e21acd408ad4de248658c4: baseline-arm64-clabbe 2026-04-19 11:34:57,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21acd408ad4de248658c4 2026-04-19 11:34:57,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:34:57,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21acd408ad4de248658c4 HTTP/1.1" 200 None 2026-04-19 11:34:57,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:34:57,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:34:57,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:34:57,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21acd408ad4de248658c4 HTTP/1.1" 200 None 2026-04-19 11:34:57,325 - lava_callback - ERROR - Error processing callback for node 69e21acd408ad4de248658c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:37:17,378 - lava_callback - INFO - Received callback for node 69e21b66408ad4de248658ff INFO: 172.21.0.1:52666 - "POST /node/69e21b66408ad4de248658ff HTTP/1.0" 202 Accepted 2026-04-19 11:37:17,384 - lava_callback - INFO - Starting async job submit for node 69e21b66408ad4de248658ff 2026-04-19 11:37:17,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:37:17,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21b66408ad4de248658ff HTTP/1.1" 200 None 2026-04-19 11:37:17,400 - lava_callback - DEBUG - Processing node 69e21b66408ad4de248658ff: baseline-arm64-clabbe 2026-04-19 11:37:17,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21b66408ad4de248658ff 2026-04-19 11:37:17,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:37:17,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21b66408ad4de248658ff HTTP/1.1" 200 None 2026-04-19 11:37:17,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:37:17,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:37:17,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:37:17,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21b66408ad4de248658ff HTTP/1.1" 200 None 2026-04-19 11:37:17,452 - lava_callback - ERROR - Error processing callback for node 69e21b66408ad4de248658ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57658 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:38:37,385 - lava_callback - INFO - Received callback for node 69e21bb3408ad4de2486591b INFO: 172.21.0.1:57660 - "POST /node/69e21bb3408ad4de2486591b HTTP/1.0" 202 Accepted 2026-04-19 11:38:37,391 - lava_callback - INFO - Starting async job submit for node 69e21bb3408ad4de2486591b 2026-04-19 11:38:37,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:38:37,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21bb3408ad4de2486591b HTTP/1.1" 200 None 2026-04-19 11:38:37,410 - lava_callback - DEBUG - Processing node 69e21bb3408ad4de2486591b: baseline-arm64-clabbe 2026-04-19 11:38:37,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e21bb3408ad4de2486591b 2026-04-19 11:38:37,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:38:37,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e21bb3408ad4de2486591b HTTP/1.1" 200 None 2026-04-19 11:38:37,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:38:37,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-19 11:38:37,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:38:37,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e21bb3408ad4de2486591b HTTP/1.1" 200 None 2026-04-19 11:38:37,475 - lava_callback - ERROR - Error processing callback for node 69e21bb3408ad4de2486591b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:50:19,629 - lava_callback - INFO - Received callback for node 69e4ab6d7ab9251d5f9173e8 INFO: 172.21.0.1:40264 - "POST /node/69e4ab6d7ab9251d5f9173e8 HTTP/1.0" 202 Accepted 2026-04-19 11:50:19,635 - lava_callback - INFO - Starting async job submit for node 69e4ab6d7ab9251d5f9173e8 2026-04-19 11:50:19,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:50:19,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ab6d7ab9251d5f9173e8 HTTP/1.1" 200 None 2026-04-19 11:50:19,696 - lava_callback - DEBUG - Processing node 69e4ab6d7ab9251d5f9173e8: baseline-arm64-broonie 2026-04-19 11:50:19,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:50:19,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:50:19,991 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4ab6d7ab9251d5f9173e8/log.txt.gz 2026-04-19 11:50:20,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:50:20,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:50:20,275 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4ab6d7ab9251d5f9173e8/lava-logs.yaml 2026-04-19 11:50:20,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-19 11:50:20,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-19 11:50:20,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e4ab6d7ab9251d5f9173e8/lava_callback.json.gz 2026-04-19 11:50:20,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:50:20,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e4ab6d7ab9251d5f9173e8 HTTP/1.1" 200 None 2026-04-19 11:50:20,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:50:20,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-19 11:50:20,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:50:20,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e4ab6d7ab9251d5f9173e8 HTTP/1.1" 200 None 2026-04-19 11:50:20,579 - lava_callback - INFO - Completed processing callback for node 69e4ab6d7ab9251d5f9173e8 INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK 2026-04-19 11:50:30,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 11:50:30,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:48:27,891 - lava_callback - INFO - Received callback for node 69e22c0f408ad4de248659ce INFO: 172.21.0.1:54664 - "POST /node/69e22c0f408ad4de248659ce HTTP/1.0" 202 Accepted 2026-04-19 12:48:27,896 - lava_callback - INFO - Starting async job submit for node 69e22c0f408ad4de248659ce 2026-04-19 12:48:27,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:48:27,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22c0f408ad4de248659ce HTTP/1.1" 200 None 2026-04-19 12:48:27,915 - lava_callback - DEBUG - Processing node 69e22c0f408ad4de248659ce: baseline-arm-baylibre 2026-04-19 12:48:27,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22c0f408ad4de248659ce 2026-04-19 12:48:27,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:48:27,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22c0f408ad4de248659ce HTTP/1.1" 200 None 2026-04-19 12:48:27,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:48:27,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:48:27,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:48:27,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22c0f408ad4de248659ce HTTP/1.1" 200 None 2026-04-19 12:48:27,964 - lava_callback - ERROR - Error processing callback for node 69e22c0f408ad4de248659ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:49:27,590 - lava_callback - INFO - Received callback for node 69e22c4a408ad4de248659de INFO: 172.21.0.1:41732 - "POST /node/69e22c4a408ad4de248659de HTTP/1.0" 202 Accepted 2026-04-19 12:49:27,595 - lava_callback - INFO - Starting async job submit for node 69e22c4a408ad4de248659de 2026-04-19 12:49:27,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:49:27,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22c4a408ad4de248659de HTTP/1.1" 200 None 2026-04-19 12:49:27,611 - lava_callback - DEBUG - Processing node 69e22c4a408ad4de248659de: baseline-arm-baylibre 2026-04-19 12:49:27,612 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22c4a408ad4de248659de 2026-04-19 12:49:27,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:49:27,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22c4a408ad4de248659de HTTP/1.1" 200 None 2026-04-19 12:49:27,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:49:27,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:49:27,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:49:27,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22c4a408ad4de248659de HTTP/1.1" 200 None 2026-04-19 12:49:27,666 - lava_callback - ERROR - Error processing callback for node 69e22c4a408ad4de248659de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40832 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:50:07,943 - lava_callback - INFO - Received callback for node 69e22c6d408ad4de248659ec INFO: 172.21.0.1:40840 - "POST /node/69e22c6d408ad4de248659ec HTTP/1.0" 202 Accepted 2026-04-19 12:50:07,949 - lava_callback - INFO - Starting async job submit for node 69e22c6d408ad4de248659ec 2026-04-19 12:50:07,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:50:07,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22c6d408ad4de248659ec HTTP/1.1" 200 None 2026-04-19 12:50:07,967 - lava_callback - DEBUG - Processing node 69e22c6d408ad4de248659ec: baseline-arm-baylibre 2026-04-19 12:50:07,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22c6d408ad4de248659ec 2026-04-19 12:50:07,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:50:07,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22c6d408ad4de248659ec HTTP/1.1" 200 None 2026-04-19 12:50:07,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:50:07,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:50:07,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:50:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22c6d408ad4de248659ec HTTP/1.1" 200 None 2026-04-19 12:50:08,015 - lava_callback - ERROR - Error processing callback for node 69e22c6d408ad4de248659ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:50:27,595 - lava_callback - INFO - Received callback for node 69e22c92408ad4de248659fe INFO: 172.21.0.1:43882 - "POST /node/69e22c92408ad4de248659fe HTTP/1.0" 202 Accepted 2026-04-19 12:50:27,601 - lava_callback - INFO - Starting async job submit for node 69e22c92408ad4de248659fe 2026-04-19 12:50:27,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:50:27,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22c92408ad4de248659fe HTTP/1.1" 200 None 2026-04-19 12:50:27,616 - lava_callback - DEBUG - Processing node 69e22c92408ad4de248659fe: baseline-arm-baylibre 2026-04-19 12:50:27,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22c92408ad4de248659fe 2026-04-19 12:50:27,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:50:27,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22c92408ad4de248659fe HTTP/1.1" 200 None 2026-04-19 12:50:27,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:50:27,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:50:27,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:50:27,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22c92408ad4de248659fe HTTP/1.1" 200 None 2026-04-19 12:50:27,672 - lava_callback - ERROR - Error processing callback for node 69e22c92408ad4de248659fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:51:07,654 - lava_callback - INFO - Received callback for node 69e22cb5408ad4de24865a0d INFO: 172.21.0.1:38246 - "POST /node/69e22cb5408ad4de24865a0d HTTP/1.0" 202 Accepted 2026-04-19 12:51:07,661 - lava_callback - INFO - Starting async job submit for node 69e22cb5408ad4de24865a0d 2026-04-19 12:51:07,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:51:07,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22cb5408ad4de24865a0d HTTP/1.1" 200 None 2026-04-19 12:51:07,688 - lava_callback - DEBUG - Processing node 69e22cb5408ad4de24865a0d: baseline-arm-baylibre 2026-04-19 12:51:07,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22cb5408ad4de24865a0d 2026-04-19 12:51:07,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:51:07,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22cb5408ad4de24865a0d HTTP/1.1" 200 None 2026-04-19 12:51:07,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:51:07,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:51:07,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:51:07,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22cb5408ad4de24865a0d HTTP/1.1" 200 None 2026-04-19 12:51:07,769 - lava_callback - ERROR - Error processing callback for node 69e22cb5408ad4de24865a0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:51:47,694 - lava_callback - INFO - Received callback for node 69e22cdb408ad4de24865a1d INFO: 172.21.0.1:57380 - "POST /node/69e22cdb408ad4de24865a1d HTTP/1.0" 202 Accepted 2026-04-19 12:51:47,700 - lava_callback - INFO - Starting async job submit for node 69e22cdb408ad4de24865a1d 2026-04-19 12:51:47,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:51:47,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22cdb408ad4de24865a1d HTTP/1.1" 200 None 2026-04-19 12:51:47,715 - lava_callback - DEBUG - Processing node 69e22cdb408ad4de24865a1d: baseline-arm-baylibre 2026-04-19 12:51:47,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22cdb408ad4de24865a1d 2026-04-19 12:51:47,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:51:47,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22cdb408ad4de24865a1d HTTP/1.1" 200 None 2026-04-19 12:51:47,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:51:47,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:51:47,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:51:47,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22cdb408ad4de24865a1d HTTP/1.1" 200 None 2026-04-19 12:51:47,763 - lava_callback - ERROR - Error processing callback for node 69e22cdb408ad4de24865a1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:52:27,748 - lava_callback - INFO - Received callback for node 69e22cff408ad4de24865a2c INFO: 172.21.0.1:54104 - "POST /node/69e22cff408ad4de24865a2c HTTP/1.0" 202 Accepted 2026-04-19 12:52:27,753 - lava_callback - INFO - Starting async job submit for node 69e22cff408ad4de24865a2c 2026-04-19 12:52:27,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:52:27,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22cff408ad4de24865a2c HTTP/1.1" 200 None 2026-04-19 12:52:27,777 - lava_callback - DEBUG - Processing node 69e22cff408ad4de24865a2c: baseline-arm-baylibre 2026-04-19 12:52:27,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22cff408ad4de24865a2c 2026-04-19 12:52:27,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:52:27,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22cff408ad4de24865a2c HTTP/1.1" 200 None 2026-04-19 12:52:27,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:52:27,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:52:27,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:52:27,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22cff408ad4de24865a2c HTTP/1.1" 200 None 2026-04-19 12:52:27,825 - lava_callback - ERROR - Error processing callback for node 69e22cff408ad4de24865a2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:53:07,839 - lava_callback - INFO - Received callback for node 69e22d24408ad4de24865a38 INFO: 172.21.0.1:44570 - "POST /node/69e22d24408ad4de24865a38 HTTP/1.0" 202 Accepted 2026-04-19 12:53:07,845 - lava_callback - INFO - Starting async job submit for node 69e22d24408ad4de24865a38 2026-04-19 12:53:07,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:53:07,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22d24408ad4de24865a38 HTTP/1.1" 200 None 2026-04-19 12:53:07,862 - lava_callback - DEBUG - Processing node 69e22d24408ad4de24865a38: baseline-arm-baylibre 2026-04-19 12:53:07,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22d24408ad4de24865a38 2026-04-19 12:53:07,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:53:07,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22d24408ad4de24865a38 HTTP/1.1" 200 None 2026-04-19 12:53:07,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:53:07,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:53:07,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:53:07,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22d24408ad4de24865a38 HTTP/1.1" 200 None 2026-04-19 12:53:07,917 - lava_callback - ERROR - Error processing callback for node 69e22d24408ad4de24865a38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:53:47,848 - lava_callback - INFO - Received callback for node 69e22d49408ad4de24865a48 INFO: 172.21.0.1:49442 - "POST /node/69e22d49408ad4de24865a48 HTTP/1.0" 202 Accepted 2026-04-19 12:53:47,853 - lava_callback - INFO - Starting async job submit for node 69e22d49408ad4de24865a48 2026-04-19 12:53:47,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:53:47,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22d49408ad4de24865a48 HTTP/1.1" 200 None 2026-04-19 12:53:47,869 - lava_callback - DEBUG - Processing node 69e22d49408ad4de24865a48: baseline-arm-baylibre 2026-04-19 12:53:47,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22d49408ad4de24865a48 2026-04-19 12:53:47,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:53:47,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22d49408ad4de24865a48 HTTP/1.1" 200 None 2026-04-19 12:53:47,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:53:47,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:53:47,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:53:47,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22d49408ad4de24865a48 HTTP/1.1" 200 None 2026-04-19 12:53:47,918 - lava_callback - ERROR - Error processing callback for node 69e22d49408ad4de24865a48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:54:07,777 - lava_callback - INFO - Received callback for node 69e22d6b408ad4de24865a57 INFO: 172.21.0.1:38328 - "POST /node/69e22d6b408ad4de24865a57 HTTP/1.0" 202 Accepted 2026-04-19 12:54:07,782 - lava_callback - INFO - Starting async job submit for node 69e22d6b408ad4de24865a57 2026-04-19 12:54:07,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:54:07,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22d6b408ad4de24865a57 HTTP/1.1" 200 None 2026-04-19 12:54:07,802 - lava_callback - DEBUG - Processing node 69e22d6b408ad4de24865a57: baseline-arm-baylibre 2026-04-19 12:54:07,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22d6b408ad4de24865a57 2026-04-19 12:54:07,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:54:07,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22d6b408ad4de24865a57 HTTP/1.1" 200 None 2026-04-19 12:54:07,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:54:07,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:54:07,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:54:07,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22d6b408ad4de24865a57 HTTP/1.1" 200 None 2026-04-19 12:54:07,849 - lava_callback - ERROR - Error processing callback for node 69e22d6b408ad4de24865a57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:54:47,859 - lava_callback - INFO - Received callback for node 69e22d91408ad4de24865a67 INFO: 172.21.0.1:57744 - "POST /node/69e22d91408ad4de24865a67 HTTP/1.0" 202 Accepted 2026-04-19 12:54:47,865 - lava_callback - INFO - Starting async job submit for node 69e22d91408ad4de24865a67 2026-04-19 12:54:47,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:54:47,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22d91408ad4de24865a67 HTTP/1.1" 200 None 2026-04-19 12:54:47,882 - lava_callback - DEBUG - Processing node 69e22d91408ad4de24865a67: baseline-arm-baylibre 2026-04-19 12:54:47,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22d91408ad4de24865a67 2026-04-19 12:54:47,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:54:47,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22d91408ad4de24865a67 HTTP/1.1" 200 None 2026-04-19 12:54:47,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:54:47,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:54:47,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:54:47,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22d91408ad4de24865a67 HTTP/1.1" 200 None 2026-04-19 12:54:47,937 - lava_callback - ERROR - Error processing callback for node 69e22d91408ad4de24865a67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:55:40,779 - lava_callback - INFO - Received callback for node 69e22db7408ad4de24865a76 INFO: 172.21.0.1:42326 - "POST /node/69e22db7408ad4de24865a76 HTTP/1.0" 202 Accepted 2026-04-19 12:55:40,785 - lava_callback - INFO - Starting async job submit for node 69e22db7408ad4de24865a76 2026-04-19 12:55:40,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:55:40,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22db7408ad4de24865a76 HTTP/1.1" 200 None 2026-04-19 12:55:40,800 - lava_callback - DEBUG - Processing node 69e22db7408ad4de24865a76: baseline-arm-clabbe 2026-04-19 12:55:40,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22db7408ad4de24865a76 2026-04-19 12:55:40,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:55:40,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22db7408ad4de24865a76 HTTP/1.1" 200 None 2026-04-19 12:55:40,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:55:40,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:55:40,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:55:40,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22db7408ad4de24865a76 HTTP/1.1" 200 None 2026-04-19 12:55:40,860 - lava_callback - ERROR - Error processing callback for node 69e22db7408ad4de24865a76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:56:07,961 - lava_callback - INFO - Received callback for node 69e22dd9408ad4de24865a84 INFO: 172.21.0.1:42720 - "POST /node/69e22dd9408ad4de24865a84 HTTP/1.0" 202 Accepted 2026-04-19 12:56:07,967 - lava_callback - INFO - Starting async job submit for node 69e22dd9408ad4de24865a84 2026-04-19 12:56:07,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:56:07,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22dd9408ad4de24865a84 HTTP/1.1" 200 None 2026-04-19 12:56:07,982 - lava_callback - DEBUG - Processing node 69e22dd9408ad4de24865a84: baseline-arm-baylibre 2026-04-19 12:56:07,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22dd9408ad4de24865a84 2026-04-19 12:56:07,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:56:07,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22dd9408ad4de24865a84 HTTP/1.1" 200 None 2026-04-19 12:56:07,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:56:08,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:56:08,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:56:08,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22dd9408ad4de24865a84 HTTP/1.1" 200 None 2026-04-19 12:56:08,094 - lava_callback - ERROR - Error processing callback for node 69e22dd9408ad4de24865a84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:56:40,653 - lava_callback - INFO - Received callback for node 69e22dff408ad4de24865a99 INFO: 172.21.0.1:58080 - "POST /node/69e22dff408ad4de24865a99 HTTP/1.0" 202 Accepted 2026-04-19 12:56:40,658 - lava_callback - INFO - Starting async job submit for node 69e22dff408ad4de24865a99 2026-04-19 12:56:40,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:56:40,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22dff408ad4de24865a99 HTTP/1.1" 200 None 2026-04-19 12:56:40,675 - lava_callback - DEBUG - Processing node 69e22dff408ad4de24865a99: baseline-arm-clabbe 2026-04-19 12:56:40,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22dff408ad4de24865a99 2026-04-19 12:56:40,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:56:40,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22dff408ad4de24865a99 HTTP/1.1" 200 None 2026-04-19 12:56:40,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:56:40,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:56:40,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:56:40,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22dff408ad4de24865a99 HTTP/1.1" 200 None 2026-04-19 12:56:40,725 - lava_callback - ERROR - Error processing callback for node 69e22dff408ad4de24865a99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:57:20,630 - lava_callback - INFO - Received callback for node 69e22e25408ad4de24865aa4 INFO: 172.21.0.1:43428 - "POST /node/69e22e25408ad4de24865aa4 HTTP/1.0" 202 Accepted 2026-04-19 12:57:20,635 - lava_callback - INFO - Starting async job submit for node 69e22e25408ad4de24865aa4 2026-04-19 12:57:20,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:57:20,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22e25408ad4de24865aa4 HTTP/1.1" 200 None 2026-04-19 12:57:20,651 - lava_callback - DEBUG - Processing node 69e22e25408ad4de24865aa4: baseline-arm-clabbe 2026-04-19 12:57:20,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22e25408ad4de24865aa4 2026-04-19 12:57:20,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:57:20,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22e25408ad4de24865aa4 HTTP/1.1" 200 None 2026-04-19 12:57:20,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:57:20,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:57:20,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:57:20,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22e25408ad4de24865aa4 HTTP/1.1" 200 None 2026-04-19 12:57:20,697 - lava_callback - ERROR - Error processing callback for node 69e22e25408ad4de24865aa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:58:00,707 - lava_callback - INFO - Received callback for node 69e22e4a408ad4de24865ab7 INFO: 172.21.0.1:43892 - "POST /node/69e22e4a408ad4de24865ab7 HTTP/1.0" 202 Accepted 2026-04-19 12:58:00,713 - lava_callback - INFO - Starting async job submit for node 69e22e4a408ad4de24865ab7 2026-04-19 12:58:00,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:58:00,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22e4a408ad4de24865ab7 HTTP/1.1" 200 None 2026-04-19 12:58:00,756 - lava_callback - DEBUG - Processing node 69e22e4a408ad4de24865ab7: baseline-arm-clabbe 2026-04-19 12:58:00,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22e4a408ad4de24865ab7 2026-04-19 12:58:00,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:58:00,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22e4a408ad4de24865ab7 HTTP/1.1" 200 None 2026-04-19 12:58:00,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:58:00,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:58:00,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:58:00,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22e4a408ad4de24865ab7 HTTP/1.1" 200 None 2026-04-19 12:58:00,854 - lava_callback - ERROR - Error processing callback for node 69e22e4a408ad4de24865ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:58:40,691 - lava_callback - INFO - Received callback for node 69e22e6e408ad4de24865ac9 INFO: 172.21.0.1:54718 - "POST /node/69e22e6e408ad4de24865ac9 HTTP/1.0" 202 Accepted 2026-04-19 12:58:40,697 - lava_callback - INFO - Starting async job submit for node 69e22e6e408ad4de24865ac9 2026-04-19 12:58:40,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:58:40,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22e6e408ad4de24865ac9 HTTP/1.1" 200 None 2026-04-19 12:58:40,713 - lava_callback - DEBUG - Processing node 69e22e6e408ad4de24865ac9: baseline-arm-clabbe 2026-04-19 12:58:40,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22e6e408ad4de24865ac9 2026-04-19 12:58:40,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:58:40,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22e6e408ad4de24865ac9 HTTP/1.1" 200 None 2026-04-19 12:58:40,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:58:40,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:58:40,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:58:40,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22e6e408ad4de24865ac9 HTTP/1.1" 200 None 2026-04-19 12:58:40,766 - lava_callback - ERROR - Error processing callback for node 69e22e6e408ad4de24865ac9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:59:20,766 - lava_callback - INFO - Received callback for node 69e22e93408ad4de24865ad4 INFO: 172.21.0.1:56222 - "POST /node/69e22e93408ad4de24865ad4 HTTP/1.0" 202 Accepted 2026-04-19 12:59:20,772 - lava_callback - INFO - Starting async job submit for node 69e22e93408ad4de24865ad4 2026-04-19 12:59:20,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:59:20,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22e93408ad4de24865ad4 HTTP/1.1" 200 None 2026-04-19 12:59:20,788 - lava_callback - DEBUG - Processing node 69e22e93408ad4de24865ad4: baseline-arm-clabbe 2026-04-19 12:59:20,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22e93408ad4de24865ad4 2026-04-19 12:59:20,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:59:20,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22e93408ad4de24865ad4 HTTP/1.1" 200 None 2026-04-19 12:59:20,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:59:20,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:59:20,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:59:20,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22e93408ad4de24865ad4 HTTP/1.1" 200 None 2026-04-19 12:59:20,838 - lava_callback - ERROR - Error processing callback for node 69e22e93408ad4de24865ad4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK 2026-04-19 12:59:40,734 - lava_callback - INFO - Received callback for node 69e22eb9408ad4de24865ae7 INFO: 172.21.0.1:42564 - "POST /node/69e22eb9408ad4de24865ae7 HTTP/1.0" 202 Accepted 2026-04-19 12:59:40,740 - lava_callback - INFO - Starting async job submit for node 69e22eb9408ad4de24865ae7 2026-04-19 12:59:40,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:59:40,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22eb9408ad4de24865ae7 HTTP/1.1" 200 None 2026-04-19 12:59:40,755 - lava_callback - DEBUG - Processing node 69e22eb9408ad4de24865ae7: baseline-arm-clabbe 2026-04-19 12:59:40,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22eb9408ad4de24865ae7 2026-04-19 12:59:40,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:59:40,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22eb9408ad4de24865ae7 HTTP/1.1" 200 None 2026-04-19 12:59:40,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:59:40,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 12:59:40,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 12:59:40,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22eb9408ad4de24865ae7 HTTP/1.1" 200 None 2026-04-19 12:59:40,811 - lava_callback - ERROR - Error processing callback for node 69e22eb9408ad4de24865ae7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:00:20,796 - lava_callback - INFO - Received callback for node 69e22ee2408ad4de24865af2 INFO: 172.21.0.1:42294 - "POST /node/69e22ee2408ad4de24865af2 HTTP/1.0" 202 Accepted 2026-04-19 13:00:20,802 - lava_callback - INFO - Starting async job submit for node 69e22ee2408ad4de24865af2 2026-04-19 13:00:20,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:00:20,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22ee2408ad4de24865af2 HTTP/1.1" 200 None 2026-04-19 13:00:20,818 - lava_callback - DEBUG - Processing node 69e22ee2408ad4de24865af2: baseline-arm-clabbe 2026-04-19 13:00:20,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22ee2408ad4de24865af2 2026-04-19 13:00:20,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:00:20,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22ee2408ad4de24865af2 HTTP/1.1" 200 None 2026-04-19 13:00:20,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:00:20,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:00:20,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:00:20,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22ee2408ad4de24865af2 HTTP/1.1" 200 None 2026-04-19 13:00:20,865 - lava_callback - ERROR - Error processing callback for node 69e22ee2408ad4de24865af2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34260 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:01:00,745 - lava_callback - INFO - Received callback for node 69e22f0a408ad4de24865b00 INFO: 172.21.0.1:42636 - "POST /node/69e22f0a408ad4de24865b00 HTTP/1.0" 202 Accepted 2026-04-19 13:01:00,750 - lava_callback - INFO - Starting async job submit for node 69e22f0a408ad4de24865b00 2026-04-19 13:01:00,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:01:00,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22f0a408ad4de24865b00 HTTP/1.1" 200 None 2026-04-19 13:01:00,766 - lava_callback - DEBUG - Processing node 69e22f0a408ad4de24865b00: baseline-arm-clabbe 2026-04-19 13:01:00,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22f0a408ad4de24865b00 2026-04-19 13:01:00,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:01:00,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22f0a408ad4de24865b00 HTTP/1.1" 200 None 2026-04-19 13:01:00,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:01:00,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:01:00,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:01:00,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22f0a408ad4de24865b00 HTTP/1.1" 200 None 2026-04-19 13:01:00,815 - lava_callback - ERROR - Error processing callback for node 69e22f0a408ad4de24865b00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:01:40,837 - lava_callback - INFO - Received callback for node 69e22f31408ad4de24865b13 INFO: 172.21.0.1:55330 - "POST /node/69e22f31408ad4de24865b13 HTTP/1.0" 202 Accepted 2026-04-19 13:01:40,843 - lava_callback - INFO - Starting async job submit for node 69e22f31408ad4de24865b13 2026-04-19 13:01:40,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:01:40,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22f31408ad4de24865b13 HTTP/1.1" 200 None 2026-04-19 13:01:40,858 - lava_callback - DEBUG - Processing node 69e22f31408ad4de24865b13: baseline-arm-clabbe 2026-04-19 13:01:40,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22f31408ad4de24865b13 2026-04-19 13:01:40,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:01:40,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22f31408ad4de24865b13 HTTP/1.1" 200 None 2026-04-19 13:01:40,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:01:40,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:01:40,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:01:40,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22f31408ad4de24865b13 HTTP/1.1" 200 None 2026-04-19 13:01:40,914 - lava_callback - ERROR - Error processing callback for node 69e22f31408ad4de24865b13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:02:28,290 - lava_callback - INFO - Received callback for node 69e22f53408ad4de24865b1c INFO: 172.21.0.1:52718 - "POST /node/69e22f53408ad4de24865b1c HTTP/1.0" 202 Accepted 2026-04-19 13:02:28,295 - lava_callback - INFO - Starting async job submit for node 69e22f53408ad4de24865b1c 2026-04-19 13:02:28,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:02:28,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22f53408ad4de24865b1c HTTP/1.1" 200 None 2026-04-19 13:02:28,323 - lava_callback - DEBUG - Processing node 69e22f53408ad4de24865b1c: baseline-arm-baylibre 2026-04-19 13:02:28,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22f53408ad4de24865b1c 2026-04-19 13:02:28,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:02:28,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22f53408ad4de24865b1c HTTP/1.1" 200 None 2026-04-19 13:02:28,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:02:28,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:02:28,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:02:28,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22f53408ad4de24865b1c HTTP/1.1" 200 None 2026-04-19 13:02:28,369 - lava_callback - ERROR - Error processing callback for node 69e22f53408ad4de24865b1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:03:00,924 - lava_callback - INFO - Received callback for node 69e22f7e408ad4de24865b2e INFO: 172.21.0.1:43522 - "POST /node/69e22f7e408ad4de24865b2e HTTP/1.0" 202 Accepted 2026-04-19 13:03:00,930 - lava_callback - INFO - Starting async job submit for node 69e22f7e408ad4de24865b2e 2026-04-19 13:03:00,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:03:00,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22f7e408ad4de24865b2e HTTP/1.1" 200 None 2026-04-19 13:03:00,947 - lava_callback - DEBUG - Processing node 69e22f7e408ad4de24865b2e: baseline-arm-clabbe 2026-04-19 13:03:00,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22f7e408ad4de24865b2e 2026-04-19 13:03:00,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:03:00,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22f7e408ad4de24865b2e HTTP/1.1" 200 None 2026-04-19 13:03:00,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:03:00,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:03:00,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:03:01,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22f7e408ad4de24865b2e HTTP/1.1" 200 None 2026-04-19 13:03:01,018 - lava_callback - ERROR - Error processing callback for node 69e22f7e408ad4de24865b2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:03:40,920 - lava_callback - INFO - Received callback for node 69e22fa7408ad4de24865b3f INFO: 172.21.0.1:50784 - "POST /node/69e22fa7408ad4de24865b3f HTTP/1.0" 202 Accepted 2026-04-19 13:03:40,925 - lava_callback - INFO - Starting async job submit for node 69e22fa7408ad4de24865b3f 2026-04-19 13:03:40,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:03:40,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22fa7408ad4de24865b3f HTTP/1.1" 200 None 2026-04-19 13:03:40,942 - lava_callback - DEBUG - Processing node 69e22fa7408ad4de24865b3f: baseline-arm-clabbe 2026-04-19 13:03:40,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22fa7408ad4de24865b3f 2026-04-19 13:03:40,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:03:40,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22fa7408ad4de24865b3f HTTP/1.1" 200 None 2026-04-19 13:03:40,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:03:40,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:03:40,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:03:41,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22fa7408ad4de24865b3f HTTP/1.1" 200 None 2026-04-19 13:03:41,004 - lava_callback - ERROR - Error processing callback for node 69e22fa7408ad4de24865b3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:04:20,973 - lava_callback - INFO - Received callback for node 69e22fcd408ad4de24865b49 INFO: 172.21.0.1:47568 - "POST /node/69e22fcd408ad4de24865b49 HTTP/1.0" 202 Accepted 2026-04-19 13:04:20,979 - lava_callback - INFO - Starting async job submit for node 69e22fcd408ad4de24865b49 2026-04-19 13:04:20,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:04:20,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22fcd408ad4de24865b49 HTTP/1.1" 200 None 2026-04-19 13:04:20,998 - lava_callback - DEBUG - Processing node 69e22fcd408ad4de24865b49: baseline-arm-clabbe 2026-04-19 13:04:20,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22fcd408ad4de24865b49 2026-04-19 13:04:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:04:21,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22fcd408ad4de24865b49 HTTP/1.1" 200 None 2026-04-19 13:04:21,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:04:21,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:04:21,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:04:21,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22fcd408ad4de24865b49 HTTP/1.1" 200 None 2026-04-19 13:04:21,066 - lava_callback - ERROR - Error processing callback for node 69e22fcd408ad4de24865b49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:05:00,990 - lava_callback - INFO - Received callback for node 69e22ff3408ad4de24865b5b INFO: 172.21.0.1:40300 - "POST /node/69e22ff3408ad4de24865b5b HTTP/1.0" 202 Accepted 2026-04-19 13:05:00,998 - lava_callback - INFO - Starting async job submit for node 69e22ff3408ad4de24865b5b 2026-04-19 13:05:00,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:05:01,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22ff3408ad4de24865b5b HTTP/1.1" 200 None 2026-04-19 13:05:01,031 - lava_callback - DEBUG - Processing node 69e22ff3408ad4de24865b5b: baseline-arm-clabbe 2026-04-19 13:05:01,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e22ff3408ad4de24865b5b 2026-04-19 13:05:01,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:05:01,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e22ff3408ad4de24865b5b HTTP/1.1" 200 None 2026-04-19 13:05:01,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:05:01,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:05:01,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:05:01,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e22ff3408ad4de24865b5b HTTP/1.1" 200 None 2026-04-19 13:05:01,134 - lava_callback - ERROR - Error processing callback for node 69e22ff3408ad4de24865b5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:05:28,810 - lava_callback - INFO - Received callback for node 69e23015408ad4de24865b6d INFO: 172.21.0.1:42012 - "POST /node/69e23015408ad4de24865b6d HTTP/1.0" 202 Accepted 2026-04-19 13:05:28,816 - lava_callback - INFO - Starting async job submit for node 69e23015408ad4de24865b6d 2026-04-19 13:05:28,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:05:28,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23015408ad4de24865b6d HTTP/1.1" 200 None 2026-04-19 13:05:28,839 - lava_callback - DEBUG - Processing node 69e23015408ad4de24865b6d: baseline-arm-baylibre 2026-04-19 13:05:28,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23015408ad4de24865b6d 2026-04-19 13:05:28,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:05:28,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23015408ad4de24865b6d HTTP/1.1" 200 None 2026-04-19 13:05:28,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:05:28,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:05:28,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:05:28,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23015408ad4de24865b6d HTTP/1.1" 200 None 2026-04-19 13:05:28,886 - lava_callback - ERROR - Error processing callback for node 69e23015408ad4de24865b6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:06:08,491 - lava_callback - INFO - Received callback for node 69e2303c408ad4de24865b7a INFO: 172.21.0.1:58054 - "POST /node/69e2303c408ad4de24865b7a HTTP/1.0" 202 Accepted 2026-04-19 13:06:08,496 - lava_callback - INFO - Starting async job submit for node 69e2303c408ad4de24865b7a 2026-04-19 13:06:08,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:06:08,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2303c408ad4de24865b7a HTTP/1.1" 200 None 2026-04-19 13:06:08,512 - lava_callback - DEBUG - Processing node 69e2303c408ad4de24865b7a: baseline-arm-baylibre 2026-04-19 13:06:08,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2303c408ad4de24865b7a 2026-04-19 13:06:08,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:06:08,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2303c408ad4de24865b7a HTTP/1.1" 200 None 2026-04-19 13:06:08,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:06:08,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:06:08,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:06:08,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2303c408ad4de24865b7a HTTP/1.1" 200 None 2026-04-19 13:06:08,586 - lava_callback - ERROR - Error processing callback for node 69e2303c408ad4de24865b7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:07:01,084 - lava_callback - INFO - Received callback for node 69e23066408ad4de24865b89 INFO: 172.21.0.1:37546 - "POST /node/69e23066408ad4de24865b89 HTTP/1.0" 202 Accepted 2026-04-19 13:07:01,089 - lava_callback - INFO - Starting async job submit for node 69e23066408ad4de24865b89 2026-04-19 13:07:01,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:07:01,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23066408ad4de24865b89 HTTP/1.1" 200 None 2026-04-19 13:07:01,126 - lava_callback - DEBUG - Processing node 69e23066408ad4de24865b89: baseline-arm-clabbe 2026-04-19 13:07:01,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23066408ad4de24865b89 2026-04-19 13:07:01,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:07:01,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23066408ad4de24865b89 HTTP/1.1" 200 None 2026-04-19 13:07:01,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:07:01,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:07:01,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:07:01,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23066408ad4de24865b89 HTTP/1.1" 200 None 2026-04-19 13:07:01,186 - lava_callback - ERROR - Error processing callback for node 69e23066408ad4de24865b89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:07:41,082 - lava_callback - INFO - Received callback for node 69e2308c408ad4de24865b9e INFO: 172.21.0.1:57054 - "POST /node/69e2308c408ad4de24865b9e HTTP/1.0" 202 Accepted 2026-04-19 13:07:41,088 - lava_callback - INFO - Starting async job submit for node 69e2308c408ad4de24865b9e 2026-04-19 13:07:41,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:07:41,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2308c408ad4de24865b9e HTTP/1.1" 200 None 2026-04-19 13:07:41,104 - lava_callback - DEBUG - Processing node 69e2308c408ad4de24865b9e: baseline-arm-clabbe 2026-04-19 13:07:41,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2308c408ad4de24865b9e 2026-04-19 13:07:41,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:07:41,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2308c408ad4de24865b9e HTTP/1.1" 200 None 2026-04-19 13:07:41,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:07:41,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:07:41,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:07:41,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2308c408ad4de24865b9e HTTP/1.1" 200 None 2026-04-19 13:07:41,155 - lava_callback - ERROR - Error processing callback for node 69e2308c408ad4de24865b9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41566 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:08:08,613 - lava_callback - INFO - Received callback for node 69e230ad408ad4de24865baa INFO: 172.21.0.1:41582 - "POST /node/69e230ad408ad4de24865baa HTTP/1.0" 202 Accepted 2026-04-19 13:08:08,618 - lava_callback - INFO - Starting async job submit for node 69e230ad408ad4de24865baa 2026-04-19 13:08:08,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:08:08,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e230ad408ad4de24865baa HTTP/1.1" 200 None 2026-04-19 13:08:08,635 - lava_callback - DEBUG - Processing node 69e230ad408ad4de24865baa: baseline-arm-baylibre 2026-04-19 13:08:08,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e230ad408ad4de24865baa 2026-04-19 13:08:08,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:08:08,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e230ad408ad4de24865baa HTTP/1.1" 200 None 2026-04-19 13:08:08,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:08:08,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:08:08,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:08:08,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e230ad408ad4de24865baa HTTP/1.1" 200 None 2026-04-19 13:08:08,682 - lava_callback - ERROR - Error processing callback for node 69e230ad408ad4de24865baa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:08:48,617 - lava_callback - INFO - Received callback for node 69e230d3408ad4de24865bc0 INFO: 172.21.0.1:46606 - "POST /node/69e230d3408ad4de24865bc0 HTTP/1.0" 202 Accepted 2026-04-19 13:08:48,623 - lava_callback - INFO - Starting async job submit for node 69e230d3408ad4de24865bc0 2026-04-19 13:08:48,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:08:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e230d3408ad4de24865bc0 HTTP/1.1" 200 None 2026-04-19 13:08:48,640 - lava_callback - DEBUG - Processing node 69e230d3408ad4de24865bc0: baseline-arm-baylibre 2026-04-19 13:08:48,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e230d3408ad4de24865bc0 2026-04-19 13:08:48,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:08:48,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e230d3408ad4de24865bc0 HTTP/1.1" 200 None 2026-04-19 13:08:48,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:08:48,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:08:48,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:08:48,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e230d3408ad4de24865bc0 HTTP/1.1" 200 None 2026-04-19 13:08:48,686 - lava_callback - ERROR - Error processing callback for node 69e230d3408ad4de24865bc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:09:21,225 - lava_callback - INFO - Received callback for node 69e230fb408ad4de24865bcc INFO: 172.21.0.1:49776 - "POST /node/69e230fb408ad4de24865bcc HTTP/1.0" 202 Accepted 2026-04-19 13:09:21,231 - lava_callback - INFO - Starting async job submit for node 69e230fb408ad4de24865bcc 2026-04-19 13:09:21,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:09:21,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e230fb408ad4de24865bcc HTTP/1.1" 200 None 2026-04-19 13:09:21,246 - lava_callback - DEBUG - Processing node 69e230fb408ad4de24865bcc: baseline-arm-clabbe 2026-04-19 13:09:21,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e230fb408ad4de24865bcc 2026-04-19 13:09:21,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:09:21,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e230fb408ad4de24865bcc HTTP/1.1" 200 None 2026-04-19 13:09:21,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:09:21,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:09:21,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:09:21,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e230fb408ad4de24865bcc HTTP/1.1" 200 None 2026-04-19 13:09:21,308 - lava_callback - ERROR - Error processing callback for node 69e230fb408ad4de24865bcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:10:01,170 - lava_callback - INFO - Received callback for node 69e2311f408ad4de24865bd9 INFO: 172.21.0.1:37994 - "POST /node/69e2311f408ad4de24865bd9 HTTP/1.0" 202 Accepted 2026-04-19 13:10:01,176 - lava_callback - INFO - Starting async job submit for node 69e2311f408ad4de24865bd9 2026-04-19 13:10:01,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:10:01,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2311f408ad4de24865bd9 HTTP/1.1" 200 None 2026-04-19 13:10:01,192 - lava_callback - DEBUG - Processing node 69e2311f408ad4de24865bd9: baseline-arm-clabbe 2026-04-19 13:10:01,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2311f408ad4de24865bd9 2026-04-19 13:10:01,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:10:01,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2311f408ad4de24865bd9 HTTP/1.1" 200 None 2026-04-19 13:10:01,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:10:01,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:10:01,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:10:01,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2311f408ad4de24865bd9 HTTP/1.1" 200 None 2026-04-19 13:10:01,241 - lava_callback - ERROR - Error processing callback for node 69e2311f408ad4de24865bd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:10:48,753 - lava_callback - INFO - Received callback for node 69e23144408ad4de24865beb INFO: 172.21.0.1:51980 - "POST /node/69e23144408ad4de24865beb HTTP/1.0" 202 Accepted 2026-04-19 13:10:48,759 - lava_callback - INFO - Starting async job submit for node 69e23144408ad4de24865beb 2026-04-19 13:10:48,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:10:48,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23144408ad4de24865beb HTTP/1.1" 200 None 2026-04-19 13:10:48,775 - lava_callback - DEBUG - Processing node 69e23144408ad4de24865beb: baseline-arm-baylibre 2026-04-19 13:10:48,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23144408ad4de24865beb 2026-04-19 13:10:48,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:10:48,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23144408ad4de24865beb HTTP/1.1" 200 None 2026-04-19 13:10:48,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:10:48,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:10:48,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:10:48,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23144408ad4de24865beb HTTP/1.1" 200 None 2026-04-19 13:10:48,833 - lava_callback - ERROR - Error processing callback for node 69e23144408ad4de24865beb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:11:21,269 - lava_callback - INFO - Received callback for node 69e2316a408ad4de24865bf9 INFO: 172.21.0.1:58216 - "POST /node/69e2316a408ad4de24865bf9 HTTP/1.0" 202 Accepted 2026-04-19 13:11:21,274 - lava_callback - INFO - Starting async job submit for node 69e2316a408ad4de24865bf9 2026-04-19 13:11:21,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:11:21,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2316a408ad4de24865bf9 HTTP/1.1" 200 None 2026-04-19 13:11:21,290 - lava_callback - DEBUG - Processing node 69e2316a408ad4de24865bf9: baseline-arm-clabbe 2026-04-19 13:11:21,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2316a408ad4de24865bf9 2026-04-19 13:11:21,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:11:21,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2316a408ad4de24865bf9 HTTP/1.1" 200 None 2026-04-19 13:11:21,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:11:21,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:11:21,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:11:21,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2316a408ad4de24865bf9 HTTP/1.1" 200 None 2026-04-19 13:11:21,347 - lava_callback - ERROR - Error processing callback for node 69e2316a408ad4de24865bf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:12:01,261 - lava_callback - INFO - Received callback for node 69e2318f408ad4de24865c06 INFO: 172.21.0.1:40146 - "POST /node/69e2318f408ad4de24865c06 HTTP/1.0" 202 Accepted 2026-04-19 13:12:01,266 - lava_callback - INFO - Starting async job submit for node 69e2318f408ad4de24865c06 2026-04-19 13:12:01,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:12:01,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2318f408ad4de24865c06 HTTP/1.1" 200 None 2026-04-19 13:12:01,289 - lava_callback - DEBUG - Processing node 69e2318f408ad4de24865c06: baseline-arm-clabbe 2026-04-19 13:12:01,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2318f408ad4de24865c06 2026-04-19 13:12:01,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:12:01,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2318f408ad4de24865c06 HTTP/1.1" 200 None 2026-04-19 13:12:01,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:12:01,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:12:01,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:12:01,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2318f408ad4de24865c06 HTTP/1.1" 200 None 2026-04-19 13:12:01,397 - lava_callback - ERROR - Error processing callback for node 69e2318f408ad4de24865c06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:12:41,340 - lava_callback - INFO - Received callback for node 69e231b4408ad4de24865c15 INFO: 172.21.0.1:32804 - "POST /node/69e231b4408ad4de24865c15 HTTP/1.0" 202 Accepted 2026-04-19 13:12:41,345 - lava_callback - INFO - Starting async job submit for node 69e231b4408ad4de24865c15 2026-04-19 13:12:41,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:12:41,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e231b4408ad4de24865c15 HTTP/1.1" 200 None 2026-04-19 13:12:41,363 - lava_callback - DEBUG - Processing node 69e231b4408ad4de24865c15: baseline-arm-clabbe 2026-04-19 13:12:41,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e231b4408ad4de24865c15 2026-04-19 13:12:41,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:12:41,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e231b4408ad4de24865c15 HTTP/1.1" 200 None 2026-04-19 13:12:41,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:12:41,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:12:41,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:12:41,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e231b4408ad4de24865c15 HTTP/1.1" 200 None 2026-04-19 13:12:41,440 - lava_callback - ERROR - Error processing callback for node 69e231b4408ad4de24865c15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:13:01,278 - lava_callback - INFO - Received callback for node 69e231d8408ad4de24865c23 INFO: 172.21.0.1:46100 - "POST /node/69e231d8408ad4de24865c23 HTTP/1.0" 202 Accepted 2026-04-19 13:13:01,283 - lava_callback - INFO - Starting async job submit for node 69e231d8408ad4de24865c23 2026-04-19 13:13:01,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:13:01,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e231d8408ad4de24865c23 HTTP/1.1" 200 None 2026-04-19 13:13:01,299 - lava_callback - DEBUG - Processing node 69e231d8408ad4de24865c23: baseline-arm-clabbe 2026-04-19 13:13:01,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e231d8408ad4de24865c23 2026-04-19 13:13:01,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:13:01,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e231d8408ad4de24865c23 HTTP/1.1" 200 None 2026-04-19 13:13:01,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:13:01,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:13:01,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:13:01,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e231d8408ad4de24865c23 HTTP/1.1" 200 None 2026-04-19 13:13:01,377 - lava_callback - ERROR - Error processing callback for node 69e231d8408ad4de24865c23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:13:41,366 - lava_callback - INFO - Received callback for node 69e231fc408ad4de24865c37 INFO: 172.21.0.1:34910 - "POST /node/69e231fc408ad4de24865c37 HTTP/1.0" 202 Accepted 2026-04-19 13:13:41,372 - lava_callback - INFO - Starting async job submit for node 69e231fc408ad4de24865c37 2026-04-19 13:13:41,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:13:41,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e231fc408ad4de24865c37 HTTP/1.1" 200 None 2026-04-19 13:13:41,416 - lava_callback - DEBUG - Processing node 69e231fc408ad4de24865c37: baseline-arm-clabbe 2026-04-19 13:13:41,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e231fc408ad4de24865c37 2026-04-19 13:13:41,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:13:41,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e231fc408ad4de24865c37 HTTP/1.1" 200 None 2026-04-19 13:13:41,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:13:41,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:13:41,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:13:41,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e231fc408ad4de24865c37 HTTP/1.1" 200 None 2026-04-19 13:13:41,478 - lava_callback - ERROR - Error processing callback for node 69e231fc408ad4de24865c37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:14:21,360 - lava_callback - INFO - Received callback for node 69e23220408ad4de24865c42 INFO: 172.21.0.1:53402 - "POST /node/69e23220408ad4de24865c42 HTTP/1.0" 202 Accepted 2026-04-19 13:14:21,366 - lava_callback - INFO - Starting async job submit for node 69e23220408ad4de24865c42 2026-04-19 13:14:21,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:14:21,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23220408ad4de24865c42 HTTP/1.1" 200 None 2026-04-19 13:14:21,392 - lava_callback - DEBUG - Processing node 69e23220408ad4de24865c42: baseline-arm-clabbe 2026-04-19 13:14:21,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23220408ad4de24865c42 2026-04-19 13:14:21,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:14:21,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23220408ad4de24865c42 HTTP/1.1" 200 None 2026-04-19 13:14:21,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:14:21,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:14:21,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:14:21,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23220408ad4de24865c42 HTTP/1.1" 200 None 2026-04-19 13:14:21,534 - lava_callback - ERROR - Error processing callback for node 69e23220408ad4de24865c42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:15:01,394 - lava_callback - INFO - Received callback for node 69e23244408ad4de24865c50 INFO: 172.21.0.1:33116 - "POST /node/69e23244408ad4de24865c50 HTTP/1.0" 202 Accepted 2026-04-19 13:15:01,399 - lava_callback - INFO - Starting async job submit for node 69e23244408ad4de24865c50 2026-04-19 13:15:01,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:15:01,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23244408ad4de24865c50 HTTP/1.1" 200 None 2026-04-19 13:15:01,435 - lava_callback - DEBUG - Processing node 69e23244408ad4de24865c50: baseline-arm-clabbe 2026-04-19 13:15:01,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23244408ad4de24865c50 2026-04-19 13:15:01,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:15:01,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23244408ad4de24865c50 HTTP/1.1" 200 None 2026-04-19 13:15:01,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:15:01,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:15:01,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:15:01,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23244408ad4de24865c50 HTTP/1.1" 200 None 2026-04-19 13:15:01,502 - lava_callback - ERROR - Error processing callback for node 69e23244408ad4de24865c50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:15:21,380 - lava_callback - INFO - Received callback for node 69e23266408ad4de24865c5e INFO: 172.21.0.1:58750 - "POST /node/69e23266408ad4de24865c5e HTTP/1.0" 202 Accepted 2026-04-19 13:15:21,386 - lava_callback - INFO - Starting async job submit for node 69e23266408ad4de24865c5e 2026-04-19 13:15:21,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:15:21,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23266408ad4de24865c5e HTTP/1.1" 200 None 2026-04-19 13:15:21,402 - lava_callback - DEBUG - Processing node 69e23266408ad4de24865c5e: baseline-arm-clabbe 2026-04-19 13:15:21,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23266408ad4de24865c5e 2026-04-19 13:15:21,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:15:21,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23266408ad4de24865c5e HTTP/1.1" 200 None 2026-04-19 13:15:21,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:15:21,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:15:21,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:15:21,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23266408ad4de24865c5e HTTP/1.1" 200 None 2026-04-19 13:15:21,459 - lava_callback - ERROR - Error processing callback for node 69e23266408ad4de24865c5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:16:01,420 - lava_callback - INFO - Received callback for node 69e2328a408ad4de24865c6e INFO: 172.21.0.1:42614 - "POST /node/69e2328a408ad4de24865c6e HTTP/1.0" 202 Accepted 2026-04-19 13:16:01,426 - lava_callback - INFO - Starting async job submit for node 69e2328a408ad4de24865c6e 2026-04-19 13:16:01,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:16:01,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2328a408ad4de24865c6e HTTP/1.1" 200 None 2026-04-19 13:16:01,451 - lava_callback - DEBUG - Processing node 69e2328a408ad4de24865c6e: baseline-arm-clabbe 2026-04-19 13:16:01,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2328a408ad4de24865c6e 2026-04-19 13:16:01,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:16:01,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2328a408ad4de24865c6e HTTP/1.1" 200 None 2026-04-19 13:16:01,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:16:01,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-19 13:16:01,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:16:01,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2328a408ad4de24865c6e HTTP/1.1" 200 None 2026-04-19 13:16:01,497 - lava_callback - ERROR - Error processing callback for node 69e2328a408ad4de24865c6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK 2026-04-19 13:58:51,900 - lava_callback - INFO - Received callback for node 69e23c8a408ad4de24865d08 INFO: 172.21.0.1:41170 - "POST /node/69e23c8a408ad4de24865d08 HTTP/1.0" 202 Accepted 2026-04-19 13:58:51,906 - lava_callback - INFO - Starting async job submit for node 69e23c8a408ad4de24865d08 2026-04-19 13:58:51,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:58:51,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23c8a408ad4de24865d08 HTTP/1.1" 200 None 2026-04-19 13:58:51,926 - lava_callback - DEBUG - Processing node 69e23c8a408ad4de24865d08: baseline-arm64-baylibre 2026-04-19 13:58:51,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23c8a408ad4de24865d08 2026-04-19 13:58:51,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:58:51,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23c8a408ad4de24865d08 HTTP/1.1" 200 None 2026-04-19 13:58:51,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:58:51,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 13:58:51,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 13:58:51,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23c8a408ad4de24865d08 HTTP/1.1" 200 None 2026-04-19 13:58:51,974 - lava_callback - ERROR - Error processing callback for node 69e23c8a408ad4de24865d08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:01:51,698 - lava_callback - INFO - Received callback for node 69e23d3e408ad4de24865d2d INFO: 172.21.0.1:38126 - "POST /node/69e23d3e408ad4de24865d2d HTTP/1.0" 202 Accepted 2026-04-19 14:01:51,703 - lava_callback - INFO - Starting async job submit for node 69e23d3e408ad4de24865d2d 2026-04-19 14:01:51,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:01:51,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23d3e408ad4de24865d2d HTTP/1.1" 200 None 2026-04-19 14:01:51,719 - lava_callback - DEBUG - Processing node 69e23d3e408ad4de24865d2d: baseline-arm64-baylibre 2026-04-19 14:01:51,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23d3e408ad4de24865d2d 2026-04-19 14:01:51,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:01:51,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23d3e408ad4de24865d2d HTTP/1.1" 200 None 2026-04-19 14:01:51,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:01:51,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:01:51,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:01:51,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23d3e408ad4de24865d2d HTTP/1.1" 200 None 2026-04-19 14:01:51,769 - lava_callback - ERROR - Error processing callback for node 69e23d3e408ad4de24865d2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:03:11,732 - lava_callback - INFO - Received callback for node 69e23d8f408ad4de24865d4b INFO: 172.21.0.1:40860 - "POST /node/69e23d8f408ad4de24865d4b HTTP/1.0" 202 Accepted 2026-04-19 14:03:11,738 - lava_callback - INFO - Starting async job submit for node 69e23d8f408ad4de24865d4b 2026-04-19 14:03:11,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:03:11,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23d8f408ad4de24865d4b HTTP/1.1" 200 None 2026-04-19 14:03:11,754 - lava_callback - DEBUG - Processing node 69e23d8f408ad4de24865d4b: baseline-arm64-baylibre 2026-04-19 14:03:11,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23d8f408ad4de24865d4b 2026-04-19 14:03:11,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:03:11,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23d8f408ad4de24865d4b HTTP/1.1" 200 None 2026-04-19 14:03:11,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:03:11,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:03:11,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:03:11,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23d8f408ad4de24865d4b HTTP/1.1" 200 None 2026-04-19 14:03:11,806 - lava_callback - ERROR - Error processing callback for node 69e23d8f408ad4de24865d4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40876 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:06:51,944 - lava_callback - INFO - Received callback for node 69e23e6d408ad4de24865d72 INFO: 172.21.0.1:50270 - "POST /node/69e23e6d408ad4de24865d72 HTTP/1.0" 202 Accepted 2026-04-19 14:06:51,950 - lava_callback - INFO - Starting async job submit for node 69e23e6d408ad4de24865d72 2026-04-19 14:06:51,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:06:51,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23e6d408ad4de24865d72 HTTP/1.1" 200 None 2026-04-19 14:06:51,967 - lava_callback - DEBUG - Processing node 69e23e6d408ad4de24865d72: baseline-arm64-baylibre 2026-04-19 14:06:51,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23e6d408ad4de24865d72 2026-04-19 14:06:51,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:06:51,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23e6d408ad4de24865d72 HTTP/1.1" 200 None 2026-04-19 14:06:51,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:06:51,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:06:51,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:06:52,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23e6d408ad4de24865d72 HTTP/1.1" 200 None 2026-04-19 14:06:52,017 - lava_callback - ERROR - Error processing callback for node 69e23e6d408ad4de24865d72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:08:52,059 - lava_callback - INFO - Received callback for node 69e23ee6408ad4de24865d95 INFO: 172.21.0.1:60424 - "POST /node/69e23ee6408ad4de24865d95 HTTP/1.0" 202 Accepted 2026-04-19 14:08:52,065 - lava_callback - INFO - Starting async job submit for node 69e23ee6408ad4de24865d95 2026-04-19 14:08:52,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:08:52,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23ee6408ad4de24865d95 HTTP/1.1" 200 None 2026-04-19 14:08:52,081 - lava_callback - DEBUG - Processing node 69e23ee6408ad4de24865d95: baseline-arm64-baylibre 2026-04-19 14:08:52,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23ee6408ad4de24865d95 2026-04-19 14:08:52,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:08:52,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23ee6408ad4de24865d95 HTTP/1.1" 200 None 2026-04-19 14:08:52,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:08:52,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:08:52,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:08:52,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23ee6408ad4de24865d95 HTTP/1.1" 200 None 2026-04-19 14:08:52,128 - lava_callback - ERROR - Error processing callback for node 69e23ee6408ad4de24865d95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51374 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:10:12,049 - lava_callback - INFO - Received callback for node 69e23f36408ad4de24865db6 INFO: 172.21.0.1:46228 - "POST /node/69e23f36408ad4de24865db6 HTTP/1.0" 202 Accepted 2026-04-19 14:10:12,055 - lava_callback - INFO - Starting async job submit for node 69e23f36408ad4de24865db6 2026-04-19 14:10:12,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:10:12,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23f36408ad4de24865db6 HTTP/1.1" 200 None 2026-04-19 14:10:12,071 - lava_callback - DEBUG - Processing node 69e23f36408ad4de24865db6: baseline-arm64-baylibre 2026-04-19 14:10:12,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23f36408ad4de24865db6 2026-04-19 14:10:12,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:10:12,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23f36408ad4de24865db6 HTTP/1.1" 200 None 2026-04-19 14:10:12,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:10:12,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:10:12,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:10:12,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23f36408ad4de24865db6 HTTP/1.1" 200 None 2026-04-19 14:10:12,140 - lava_callback - ERROR - Error processing callback for node 69e23f36408ad4de24865db6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:11:32,183 - lava_callback - INFO - Received callback for node 69e23f85408ad4de24865dd7 INFO: 172.21.0.1:47102 - "POST /node/69e23f85408ad4de24865dd7 HTTP/1.0" 202 Accepted 2026-04-19 14:11:32,192 - lava_callback - INFO - Starting async job submit for node 69e23f85408ad4de24865dd7 2026-04-19 14:11:32,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:11:32,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23f85408ad4de24865dd7 HTTP/1.1" 200 None 2026-04-19 14:11:32,210 - lava_callback - DEBUG - Processing node 69e23f85408ad4de24865dd7: baseline-arm64-baylibre 2026-04-19 14:11:32,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23f85408ad4de24865dd7 2026-04-19 14:11:32,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:11:32,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23f85408ad4de24865dd7 HTTP/1.1" 200 None 2026-04-19 14:11:32,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:11:32,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:11:32,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:11:32,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23f85408ad4de24865dd7 HTTP/1.1" 200 None 2026-04-19 14:11:32,273 - lava_callback - ERROR - Error processing callback for node 69e23f85408ad4de24865dd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:12:53,016 - lava_callback - INFO - Received callback for node 69e23fd6408ad4de24865dfc INFO: 172.21.0.1:38224 - "POST /node/69e23fd6408ad4de24865dfc HTTP/1.0" 202 Accepted 2026-04-19 14:12:53,021 - lava_callback - INFO - Starting async job submit for node 69e23fd6408ad4de24865dfc 2026-04-19 14:12:53,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:12:53,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23fd6408ad4de24865dfc HTTP/1.1" 200 None 2026-04-19 14:12:53,038 - lava_callback - DEBUG - Processing node 69e23fd6408ad4de24865dfc: baseline-arm64-baylibre 2026-04-19 14:12:53,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e23fd6408ad4de24865dfc 2026-04-19 14:12:53,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:12:53,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e23fd6408ad4de24865dfc HTTP/1.1" 200 None 2026-04-19 14:12:53,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:12:53,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:12:53,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:12:53,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e23fd6408ad4de24865dfc HTTP/1.1" 200 None 2026-04-19 14:12:53,087 - lava_callback - ERROR - Error processing callback for node 69e23fd6408ad4de24865dfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:14:12,311 - lava_callback - INFO - Received callback for node 69e24026408ad4de24865e19 INFO: 172.21.0.1:39902 - "POST /node/69e24026408ad4de24865e19 HTTP/1.0" 202 Accepted 2026-04-19 14:14:12,317 - lava_callback - INFO - Starting async job submit for node 69e24026408ad4de24865e19 2026-04-19 14:14:12,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:14:12,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24026408ad4de24865e19 HTTP/1.1" 200 None 2026-04-19 14:14:12,338 - lava_callback - DEBUG - Processing node 69e24026408ad4de24865e19: baseline-arm64-baylibre 2026-04-19 14:14:12,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24026408ad4de24865e19 2026-04-19 14:14:12,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:14:12,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24026408ad4de24865e19 HTTP/1.1" 200 None 2026-04-19 14:14:12,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:14:12,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:14:12,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:14:12,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24026408ad4de24865e19 HTTP/1.1" 200 None 2026-04-19 14:14:12,389 - lava_callback - ERROR - Error processing callback for node 69e24026408ad4de24865e19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42654 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:15:32,358 - lava_callback - INFO - Received callback for node 69e24075408ad4de24865e4f INFO: 172.21.0.1:35392 - "POST /node/69e24075408ad4de24865e4f HTTP/1.0" 202 Accepted 2026-04-19 14:15:32,364 - lava_callback - INFO - Starting async job submit for node 69e24075408ad4de24865e4f 2026-04-19 14:15:32,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:15:32,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24075408ad4de24865e4f HTTP/1.1" 200 None 2026-04-19 14:15:32,381 - lava_callback - DEBUG - Processing node 69e24075408ad4de24865e4f: baseline-arm64-baylibre 2026-04-19 14:15:32,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24075408ad4de24865e4f 2026-04-19 14:15:32,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:15:32,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24075408ad4de24865e4f HTTP/1.1" 200 None 2026-04-19 14:15:32,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:15:32,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:15:32,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:15:32,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24075408ad4de24865e4f HTTP/1.1" 200 None 2026-04-19 14:15:32,439 - lava_callback - ERROR - Error processing callback for node 69e24075408ad4de24865e4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:16:52,441 - lava_callback - INFO - Received callback for node 69e240c5408ad4de24865e72 INFO: 172.21.0.1:44980 - "POST /node/69e240c5408ad4de24865e72 HTTP/1.0" 202 Accepted 2026-04-19 14:16:52,446 - lava_callback - INFO - Starting async job submit for node 69e240c5408ad4de24865e72 2026-04-19 14:16:52,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:16:52,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e240c5408ad4de24865e72 HTTP/1.1" 200 None 2026-04-19 14:16:52,463 - lava_callback - DEBUG - Processing node 69e240c5408ad4de24865e72: baseline-arm64-baylibre 2026-04-19 14:16:52,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e240c5408ad4de24865e72 2026-04-19 14:16:52,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:16:52,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e240c5408ad4de24865e72 HTTP/1.1" 200 None 2026-04-19 14:16:52,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:16:52,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:16:52,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:16:52,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e240c5408ad4de24865e72 HTTP/1.1" 200 None 2026-04-19 14:16:52,519 - lava_callback - ERROR - Error processing callback for node 69e240c5408ad4de24865e72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:18:44,170 - lava_callback - INFO - Received callback for node 69e24134408ad4de24865e9c INFO: 172.21.0.1:35634 - "POST /node/69e24134408ad4de24865e9c HTTP/1.0" 202 Accepted 2026-04-19 14:18:44,177 - lava_callback - INFO - Starting async job submit for node 69e24134408ad4de24865e9c 2026-04-19 14:18:44,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:18:44,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24134408ad4de24865e9c HTTP/1.1" 200 None 2026-04-19 14:18:44,199 - lava_callback - DEBUG - Processing node 69e24134408ad4de24865e9c: baseline-arm64-clabbe 2026-04-19 14:18:44,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24134408ad4de24865e9c 2026-04-19 14:18:44,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:18:44,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24134408ad4de24865e9c HTTP/1.1" 200 None 2026-04-19 14:18:44,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:18:44,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:18:44,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:18:44,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24134408ad4de24865e9c HTTP/1.1" 200 None 2026-04-19 14:18:44,269 - lava_callback - ERROR - Error processing callback for node 69e24134408ad4de24865e9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:20:04,309 - lava_callback - INFO - Received callback for node 69e24183408ad4de24865ebe INFO: 172.21.0.1:45218 - "POST /node/69e24183408ad4de24865ebe HTTP/1.0" 202 Accepted 2026-04-19 14:20:04,315 - lava_callback - INFO - Starting async job submit for node 69e24183408ad4de24865ebe 2026-04-19 14:20:04,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:20:04,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24183408ad4de24865ebe HTTP/1.1" 200 None 2026-04-19 14:20:04,336 - lava_callback - DEBUG - Processing node 69e24183408ad4de24865ebe: baseline-arm64-clabbe 2026-04-19 14:20:04,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24183408ad4de24865ebe 2026-04-19 14:20:04,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:20:04,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24183408ad4de24865ebe HTTP/1.1" 200 None 2026-04-19 14:20:04,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:20:04,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:20:04,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:20:04,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24183408ad4de24865ebe HTTP/1.1" 200 None 2026-04-19 14:20:04,393 - lava_callback - ERROR - Error processing callback for node 69e24183408ad4de24865ebe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:21:24,207 - lava_callback - INFO - Received callback for node 69e241d3408ad4de24865ee5 INFO: 172.21.0.1:60562 - "POST /node/69e241d3408ad4de24865ee5 HTTP/1.0" 202 Accepted 2026-04-19 14:21:24,213 - lava_callback - INFO - Starting async job submit for node 69e241d3408ad4de24865ee5 2026-04-19 14:21:24,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:21:24,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e241d3408ad4de24865ee5 HTTP/1.1" 200 None 2026-04-19 14:21:24,229 - lava_callback - DEBUG - Processing node 69e241d3408ad4de24865ee5: baseline-arm64-clabbe 2026-04-19 14:21:24,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e241d3408ad4de24865ee5 2026-04-19 14:21:24,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:21:24,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e241d3408ad4de24865ee5 HTTP/1.1" 200 None 2026-04-19 14:21:24,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:21:24,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:21:24,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:21:24,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e241d3408ad4de24865ee5 HTTP/1.1" 200 None 2026-04-19 14:21:24,276 - lava_callback - ERROR - Error processing callback for node 69e241d3408ad4de24865ee5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:22:44,328 - lava_callback - INFO - Received callback for node 69e24225408ad4de24865efe INFO: 172.21.0.1:35622 - "POST /node/69e24225408ad4de24865efe HTTP/1.0" 202 Accepted 2026-04-19 14:22:44,333 - lava_callback - INFO - Starting async job submit for node 69e24225408ad4de24865efe 2026-04-19 14:22:44,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:22:44,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24225408ad4de24865efe HTTP/1.1" 200 None 2026-04-19 14:22:44,351 - lava_callback - DEBUG - Processing node 69e24225408ad4de24865efe: baseline-arm64-clabbe 2026-04-19 14:22:44,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24225408ad4de24865efe 2026-04-19 14:22:44,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:22:44,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24225408ad4de24865efe HTTP/1.1" 200 None 2026-04-19 14:22:44,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:22:44,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-19 14:22:44,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:22:44,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24225408ad4de24865efe HTTP/1.1" 200 None 2026-04-19 14:22:44,418 - lava_callback - ERROR - Error processing callback for node 69e24225408ad4de24865efe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:33:33,526 - lava_callback - INFO - Received callback for node 69e244b6408ad4de24865f37 INFO: 172.21.0.1:49548 - "POST /node/69e244b6408ad4de24865f37 HTTP/1.0" 202 Accepted 2026-04-19 14:33:33,533 - lava_callback - INFO - Starting async job submit for node 69e244b6408ad4de24865f37 2026-04-19 14:33:33,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:33:33,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e244b6408ad4de24865f37 HTTP/1.1" 200 None 2026-04-19 14:33:33,558 - lava_callback - DEBUG - Processing node 69e244b6408ad4de24865f37: baseline-arm-baylibre 2026-04-19 14:33:33,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e244b6408ad4de24865f37 2026-04-19 14:33:33,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:33:33,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e244b6408ad4de24865f37 HTTP/1.1" 200 None 2026-04-19 14:33:33,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:33:33,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:33:33,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:33:33,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e244b6408ad4de24865f37 HTTP/1.1" 200 None 2026-04-19 14:33:33,633 - lava_callback - ERROR - Error processing callback for node 69e244b6408ad4de24865f37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:34:33,359 - lava_callback - INFO - Received callback for node 69e244ec408ad4de24865f45 INFO: 172.21.0.1:44740 - "POST /node/69e244ec408ad4de24865f45 HTTP/1.0" 202 Accepted 2026-04-19 14:34:33,364 - lava_callback - INFO - Starting async job submit for node 69e244ec408ad4de24865f45 2026-04-19 14:34:33,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:34:33,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e244ec408ad4de24865f45 HTTP/1.1" 200 None 2026-04-19 14:34:33,380 - lava_callback - DEBUG - Processing node 69e244ec408ad4de24865f45: baseline-arm-baylibre 2026-04-19 14:34:33,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e244ec408ad4de24865f45 2026-04-19 14:34:33,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:34:33,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e244ec408ad4de24865f45 HTTP/1.1" 200 None 2026-04-19 14:34:33,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:34:33,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:34:33,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:34:33,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e244ec408ad4de24865f45 HTTP/1.1" 200 None 2026-04-19 14:34:33,440 - lava_callback - ERROR - Error processing callback for node 69e244ec408ad4de24865f45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47938 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:35:13,452 - lava_callback - INFO - Received callback for node 69e24510408ad4de24865f54 INFO: 172.21.0.1:51264 - "POST /node/69e24510408ad4de24865f54 HTTP/1.0" 202 Accepted 2026-04-19 14:35:13,461 - lava_callback - INFO - Starting async job submit for node 69e24510408ad4de24865f54 2026-04-19 14:35:13,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:35:13,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24510408ad4de24865f54 HTTP/1.1" 200 None 2026-04-19 14:35:13,478 - lava_callback - DEBUG - Processing node 69e24510408ad4de24865f54: baseline-arm-baylibre 2026-04-19 14:35:13,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24510408ad4de24865f54 2026-04-19 14:35:13,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:35:13,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24510408ad4de24865f54 HTTP/1.1" 200 None 2026-04-19 14:35:13,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:35:13,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:35:13,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:35:13,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24510408ad4de24865f54 HTTP/1.1" 200 None 2026-04-19 14:35:13,541 - lava_callback - ERROR - Error processing callback for node 69e24510408ad4de24865f54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:35:53,453 - lava_callback - INFO - Received callback for node 69e24534408ad4de24865f66 INFO: 172.21.0.1:33028 - "POST /node/69e24534408ad4de24865f66 HTTP/1.0" 202 Accepted 2026-04-19 14:35:53,458 - lava_callback - INFO - Starting async job submit for node 69e24534408ad4de24865f66 2026-04-19 14:35:53,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:35:53,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24534408ad4de24865f66 HTTP/1.1" 200 None 2026-04-19 14:35:53,473 - lava_callback - DEBUG - Processing node 69e24534408ad4de24865f66: baseline-arm-baylibre 2026-04-19 14:35:53,474 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24534408ad4de24865f66 2026-04-19 14:35:53,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:35:53,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24534408ad4de24865f66 HTTP/1.1" 200 None 2026-04-19 14:35:53,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:35:53,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:35:53,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:35:53,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24534408ad4de24865f66 HTTP/1.1" 200 None 2026-04-19 14:35:53,523 - lava_callback - ERROR - Error processing callback for node 69e24534408ad4de24865f66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:36:13,467 - lava_callback - INFO - Received callback for node 69e24559408ad4de24865f79 INFO: 172.21.0.1:51402 - "POST /node/69e24559408ad4de24865f79 HTTP/1.0" 202 Accepted 2026-04-19 14:36:13,472 - lava_callback - INFO - Starting async job submit for node 69e24559408ad4de24865f79 2026-04-19 14:36:13,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:36:13,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24559408ad4de24865f79 HTTP/1.1" 200 None 2026-04-19 14:36:13,490 - lava_callback - DEBUG - Processing node 69e24559408ad4de24865f79: baseline-arm-baylibre 2026-04-19 14:36:13,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24559408ad4de24865f79 2026-04-19 14:36:13,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:36:13,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24559408ad4de24865f79 HTTP/1.1" 200 None 2026-04-19 14:36:13,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:36:13,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:36:13,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:36:13,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24559408ad4de24865f79 HTTP/1.1" 200 None 2026-04-19 14:36:13,536 - lava_callback - ERROR - Error processing callback for node 69e24559408ad4de24865f79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:36:53,571 - lava_callback - INFO - Received callback for node 69e2457e408ad4de24865f8f INFO: 172.21.0.1:36934 - "POST /node/69e2457e408ad4de24865f8f HTTP/1.0" 202 Accepted 2026-04-19 14:36:53,580 - lava_callback - INFO - Starting async job submit for node 69e2457e408ad4de24865f8f 2026-04-19 14:36:53,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:36:53,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2457e408ad4de24865f8f HTTP/1.1" 200 None 2026-04-19 14:36:53,597 - lava_callback - DEBUG - Processing node 69e2457e408ad4de24865f8f: baseline-arm-baylibre 2026-04-19 14:36:53,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2457e408ad4de24865f8f 2026-04-19 14:36:53,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:36:53,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2457e408ad4de24865f8f HTTP/1.1" 200 None 2026-04-19 14:36:53,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:36:53,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:36:53,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:36:53,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2457e408ad4de24865f8f HTTP/1.1" 200 None 2026-04-19 14:36:53,671 - lava_callback - ERROR - Error processing callback for node 69e2457e408ad4de24865f8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:38:13,716 - lava_callback - INFO - Received callback for node 69e245c6408ad4de24865faa INFO: 172.21.0.1:49564 - "POST /node/69e245c6408ad4de24865faa HTTP/1.0" 202 Accepted 2026-04-19 14:38:13,723 - lava_callback - INFO - Starting async job submit for node 69e245c6408ad4de24865faa 2026-04-19 14:38:13,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:38:13,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e245c6408ad4de24865faa HTTP/1.1" 200 None 2026-04-19 14:38:13,744 - lava_callback - DEBUG - Processing node 69e245c6408ad4de24865faa: baseline-arm-baylibre 2026-04-19 14:38:13,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e245c6408ad4de24865faa 2026-04-19 14:38:13,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:38:13,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e245c6408ad4de24865faa HTTP/1.1" 200 None 2026-04-19 14:38:13,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:38:13,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:38:13,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:38:13,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e245c6408ad4de24865faa HTTP/1.1" 200 None 2026-04-19 14:38:13,812 - lava_callback - ERROR - Error processing callback for node 69e245c6408ad4de24865faa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:38:53,702 - lava_callback - INFO - Received callback for node 69e245ec408ad4de24865fbd INFO: 172.21.0.1:37702 - "POST /node/69e245ec408ad4de24865fbd HTTP/1.0" 202 Accepted 2026-04-19 14:38:53,711 - lava_callback - INFO - Starting async job submit for node 69e245ec408ad4de24865fbd 2026-04-19 14:38:53,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:38:53,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e245ec408ad4de24865fbd HTTP/1.1" 200 None 2026-04-19 14:38:53,728 - lava_callback - DEBUG - Processing node 69e245ec408ad4de24865fbd: baseline-arm-baylibre 2026-04-19 14:38:53,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e245ec408ad4de24865fbd 2026-04-19 14:38:53,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:38:53,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e245ec408ad4de24865fbd HTTP/1.1" 200 None 2026-04-19 14:38:53,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:38:53,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:38:53,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:38:53,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e245ec408ad4de24865fbd HTTP/1.1" 200 None 2026-04-19 14:38:53,787 - lava_callback - ERROR - Error processing callback for node 69e245ec408ad4de24865fbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:39:33,995 - lava_callback - INFO - Received callback for node 69e24610408ad4de24865fcc INFO: 172.21.0.1:51140 - "POST /node/69e24610408ad4de24865fcc HTTP/1.0" 202 Accepted 2026-04-19 14:39:34,001 - lava_callback - INFO - Starting async job submit for node 69e24610408ad4de24865fcc 2026-04-19 14:39:34,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:39:34,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24610408ad4de24865fcc HTTP/1.1" 200 None 2026-04-19 14:39:34,018 - lava_callback - DEBUG - Processing node 69e24610408ad4de24865fcc: baseline-arm-baylibre 2026-04-19 14:39:34,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24610408ad4de24865fcc 2026-04-19 14:39:34,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:39:34,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24610408ad4de24865fcc HTTP/1.1" 200 None 2026-04-19 14:39:34,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:39:34,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:39:34,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:39:34,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24610408ad4de24865fcc HTTP/1.1" 200 None 2026-04-19 14:39:34,066 - lava_callback - ERROR - Error processing callback for node 69e24610408ad4de24865fcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:39:53,687 - lava_callback - INFO - Received callback for node 69e24633408ad4de24865fdd INFO: 172.21.0.1:48820 - "POST /node/69e24633408ad4de24865fdd HTTP/1.0" 202 Accepted 2026-04-19 14:39:53,693 - lava_callback - INFO - Starting async job submit for node 69e24633408ad4de24865fdd 2026-04-19 14:39:53,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:39:53,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24633408ad4de24865fdd HTTP/1.1" 200 None 2026-04-19 14:39:53,708 - lava_callback - DEBUG - Processing node 69e24633408ad4de24865fdd: baseline-arm-baylibre 2026-04-19 14:39:53,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24633408ad4de24865fdd 2026-04-19 14:39:53,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:39:53,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24633408ad4de24865fdd HTTP/1.1" 200 None 2026-04-19 14:39:53,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:39:53,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:39:53,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:39:53,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24633408ad4de24865fdd HTTP/1.1" 200 None 2026-04-19 14:39:53,756 - lava_callback - ERROR - Error processing callback for node 69e24633408ad4de24865fdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:40:33,735 - lava_callback - INFO - Received callback for node 69e24658408ad4de24865ff0 INFO: 172.21.0.1:37772 - "POST /node/69e24658408ad4de24865ff0 HTTP/1.0" 202 Accepted 2026-04-19 14:40:33,741 - lava_callback - INFO - Starting async job submit for node 69e24658408ad4de24865ff0 2026-04-19 14:40:33,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:40:33,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24658408ad4de24865ff0 HTTP/1.1" 200 None 2026-04-19 14:40:33,757 - lava_callback - DEBUG - Processing node 69e24658408ad4de24865ff0: baseline-arm-baylibre 2026-04-19 14:40:33,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24658408ad4de24865ff0 2026-04-19 14:40:33,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:40:33,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24658408ad4de24865ff0 HTTP/1.1" 200 None 2026-04-19 14:40:33,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:40:33,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:40:33,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:40:33,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24658408ad4de24865ff0 HTTP/1.1" 200 None 2026-04-19 14:40:33,811 - lava_callback - ERROR - Error processing callback for node 69e24658408ad4de24865ff0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42406 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:41:25,074 - lava_callback - INFO - Received callback for node 69e2467e408ad4de24866001 INFO: 172.21.0.1:47932 - "POST /node/69e2467e408ad4de24866001 HTTP/1.0" 202 Accepted 2026-04-19 14:41:25,080 - lava_callback - INFO - Starting async job submit for node 69e2467e408ad4de24866001 2026-04-19 14:41:25,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:41:25,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2467e408ad4de24866001 HTTP/1.1" 200 None 2026-04-19 14:41:25,096 - lava_callback - DEBUG - Processing node 69e2467e408ad4de24866001: baseline-arm-clabbe 2026-04-19 14:41:25,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2467e408ad4de24866001 2026-04-19 14:41:25,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:41:25,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2467e408ad4de24866001 HTTP/1.1" 200 None 2026-04-19 14:41:25,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:41:25,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:41:25,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:41:25,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2467e408ad4de24866001 HTTP/1.1" 200 None 2026-04-19 14:41:25,146 - lava_callback - ERROR - Error processing callback for node 69e2467e408ad4de24866001: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:41:45,175 - lava_callback - INFO - Received callback for node 69e246a4408ad4de24866018 INFO: 172.21.0.1:57708 - "POST /node/69e246a4408ad4de24866018 HTTP/1.0" 202 Accepted 2026-04-19 14:41:45,180 - lava_callback - INFO - Starting async job submit for node 69e246a4408ad4de24866018 2026-04-19 14:41:45,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:41:45,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e246a4408ad4de24866018 HTTP/1.1" 200 None 2026-04-19 14:41:45,196 - lava_callback - DEBUG - Processing node 69e246a4408ad4de24866018: baseline-arm-clabbe 2026-04-19 14:41:45,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e246a4408ad4de24866018 2026-04-19 14:41:45,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:41:45,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e246a4408ad4de24866018 HTTP/1.1" 200 None 2026-04-19 14:41:45,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:41:45,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:41:45,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:41:45,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e246a4408ad4de24866018 HTTP/1.1" 200 None 2026-04-19 14:41:45,244 - lava_callback - ERROR - Error processing callback for node 69e246a4408ad4de24866018: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:42:25,089 - lava_callback - INFO - Received callback for node 69e246c9408ad4de2486602b INFO: 172.21.0.1:55900 - "POST /node/69e246c9408ad4de2486602b HTTP/1.0" 202 Accepted 2026-04-19 14:42:25,095 - lava_callback - INFO - Starting async job submit for node 69e246c9408ad4de2486602b 2026-04-19 14:42:25,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:42:25,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e246c9408ad4de2486602b HTTP/1.1" 200 None 2026-04-19 14:42:25,111 - lava_callback - DEBUG - Processing node 69e246c9408ad4de2486602b: baseline-arm-clabbe 2026-04-19 14:42:25,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e246c9408ad4de2486602b 2026-04-19 14:42:25,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:42:25,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e246c9408ad4de2486602b HTTP/1.1" 200 None 2026-04-19 14:42:25,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:42:25,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:42:25,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:42:25,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e246c9408ad4de2486602b HTTP/1.1" 200 None 2026-04-19 14:42:25,175 - lava_callback - ERROR - Error processing callback for node 69e246c9408ad4de2486602b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:43:05,081 - lava_callback - INFO - Received callback for node 69e246ee408ad4de2486606f INFO: 172.21.0.1:42396 - "POST /node/69e246ee408ad4de2486606f HTTP/1.0" 202 Accepted 2026-04-19 14:43:05,087 - lava_callback - INFO - Starting async job submit for node 69e246ee408ad4de2486606f 2026-04-19 14:43:05,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:43:05,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e246ee408ad4de2486606f HTTP/1.1" 200 None 2026-04-19 14:43:05,103 - lava_callback - DEBUG - Processing node 69e246ee408ad4de2486606f: baseline-arm-clabbe 2026-04-19 14:43:05,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e246ee408ad4de2486606f 2026-04-19 14:43:05,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:43:05,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e246ee408ad4de2486606f HTTP/1.1" 200 None 2026-04-19 14:43:05,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:43:05,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:43:05,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:43:05,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e246ee408ad4de2486606f HTTP/1.1" 200 None 2026-04-19 14:43:05,160 - lava_callback - ERROR - Error processing callback for node 69e246ee408ad4de2486606f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:43:45,203 - lava_callback - INFO - Received callback for node 69e24713408ad4de24866082 INFO: 172.21.0.1:47048 - "POST /node/69e24713408ad4de24866082 HTTP/1.0" 202 Accepted 2026-04-19 14:43:45,208 - lava_callback - INFO - Starting async job submit for node 69e24713408ad4de24866082 2026-04-19 14:43:45,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:43:45,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24713408ad4de24866082 HTTP/1.1" 200 None 2026-04-19 14:43:45,224 - lava_callback - DEBUG - Processing node 69e24713408ad4de24866082: baseline-arm-clabbe 2026-04-19 14:43:45,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24713408ad4de24866082 2026-04-19 14:43:45,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:43:45,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24713408ad4de24866082 HTTP/1.1" 200 None 2026-04-19 14:43:45,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:43:45,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:43:45,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:43:45,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24713408ad4de24866082 HTTP/1.1" 200 None 2026-04-19 14:43:45,279 - lava_callback - ERROR - Error processing callback for node 69e24713408ad4de24866082: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:44:25,099 - lava_callback - INFO - Received callback for node 69e24738408ad4de24866093 INFO: 172.21.0.1:49358 - "POST /node/69e24738408ad4de24866093 HTTP/1.0" 202 Accepted 2026-04-19 14:44:25,105 - lava_callback - INFO - Starting async job submit for node 69e24738408ad4de24866093 2026-04-19 14:44:25,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:44:25,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24738408ad4de24866093 HTTP/1.1" 200 None 2026-04-19 14:44:25,121 - lava_callback - DEBUG - Processing node 69e24738408ad4de24866093: baseline-arm-clabbe 2026-04-19 14:44:25,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24738408ad4de24866093 2026-04-19 14:44:25,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:44:25,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24738408ad4de24866093 HTTP/1.1" 200 None 2026-04-19 14:44:25,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:44:25,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:44:25,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:44:25,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24738408ad4de24866093 HTTP/1.1" 200 None 2026-04-19 14:44:25,168 - lava_callback - ERROR - Error processing callback for node 69e24738408ad4de24866093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:45:05,149 - lava_callback - INFO - Received callback for node 69e2475d408ad4de2486609f INFO: 172.21.0.1:59006 - "POST /node/69e2475d408ad4de2486609f HTTP/1.0" 202 Accepted 2026-04-19 14:45:05,156 - lava_callback - INFO - Starting async job submit for node 69e2475d408ad4de2486609f 2026-04-19 14:45:05,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:45:05,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2475d408ad4de2486609f HTTP/1.1" 200 None 2026-04-19 14:45:05,171 - lava_callback - DEBUG - Processing node 69e2475d408ad4de2486609f: baseline-arm-clabbe 2026-04-19 14:45:05,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2475d408ad4de2486609f 2026-04-19 14:45:05,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:45:05,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2475d408ad4de2486609f HTTP/1.1" 200 None 2026-04-19 14:45:05,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:45:05,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:45:05,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:45:05,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2475d408ad4de2486609f HTTP/1.1" 200 None 2026-04-19 14:45:05,226 - lava_callback - ERROR - Error processing callback for node 69e2475d408ad4de2486609f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:45:25,129 - lava_callback - INFO - Received callback for node 69e24782408ad4de248660ad INFO: 172.21.0.1:43622 - "POST /node/69e24782408ad4de248660ad HTTP/1.0" 202 Accepted 2026-04-19 14:45:25,135 - lava_callback - INFO - Starting async job submit for node 69e24782408ad4de248660ad 2026-04-19 14:45:25,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:45:25,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24782408ad4de248660ad HTTP/1.1" 200 None 2026-04-19 14:45:25,155 - lava_callback - DEBUG - Processing node 69e24782408ad4de248660ad: baseline-arm-clabbe 2026-04-19 14:45:25,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24782408ad4de248660ad 2026-04-19 14:45:25,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:45:25,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24782408ad4de248660ad HTTP/1.1" 200 None 2026-04-19 14:45:25,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:45:25,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:45:25,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:45:25,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24782408ad4de248660ad HTTP/1.1" 200 None 2026-04-19 14:45:25,209 - lava_callback - ERROR - Error processing callback for node 69e24782408ad4de248660ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59166 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:46:05,188 - lava_callback - INFO - Received callback for node 69e247a7408ad4de248660bc INFO: 172.21.0.1:57606 - "POST /node/69e247a7408ad4de248660bc HTTP/1.0" 202 Accepted 2026-04-19 14:46:05,193 - lava_callback - INFO - Starting async job submit for node 69e247a7408ad4de248660bc 2026-04-19 14:46:05,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:46:05,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e247a7408ad4de248660bc HTTP/1.1" 200 None 2026-04-19 14:46:05,210 - lava_callback - DEBUG - Processing node 69e247a7408ad4de248660bc: baseline-arm-clabbe 2026-04-19 14:46:05,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e247a7408ad4de248660bc 2026-04-19 14:46:05,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:46:05,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e247a7408ad4de248660bc HTTP/1.1" 200 None 2026-04-19 14:46:05,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:46:05,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:46:05,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:46:05,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e247a7408ad4de248660bc HTTP/1.1" 200 None 2026-04-19 14:46:05,276 - lava_callback - ERROR - Error processing callback for node 69e247a7408ad4de248660bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:46:45,180 - lava_callback - INFO - Received callback for node 69e247cc408ad4de248660cd INFO: 172.21.0.1:50016 - "POST /node/69e247cc408ad4de248660cd HTTP/1.0" 202 Accepted 2026-04-19 14:46:45,186 - lava_callback - INFO - Starting async job submit for node 69e247cc408ad4de248660cd 2026-04-19 14:46:45,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:46:45,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e247cc408ad4de248660cd HTTP/1.1" 200 None 2026-04-19 14:46:45,202 - lava_callback - DEBUG - Processing node 69e247cc408ad4de248660cd: baseline-arm-clabbe 2026-04-19 14:46:45,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e247cc408ad4de248660cd 2026-04-19 14:46:45,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:46:45,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e247cc408ad4de248660cd HTTP/1.1" 200 None 2026-04-19 14:46:45,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:46:45,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:46:45,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:46:45,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e247cc408ad4de248660cd HTTP/1.1" 200 None 2026-04-19 14:46:45,254 - lava_callback - ERROR - Error processing callback for node 69e247cc408ad4de248660cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:48:45,322 - lava_callback - INFO - Received callback for node 69e2483a408ad4de248660f3 INFO: 172.21.0.1:56902 - "POST /node/69e2483a408ad4de248660f3 HTTP/1.0" 202 Accepted 2026-04-19 14:48:45,328 - lava_callback - INFO - Starting async job submit for node 69e2483a408ad4de248660f3 2026-04-19 14:48:45,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:48:45,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2483a408ad4de248660f3 HTTP/1.1" 200 None 2026-04-19 14:48:45,344 - lava_callback - DEBUG - Processing node 69e2483a408ad4de248660f3: baseline-arm-clabbe 2026-04-19 14:48:45,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2483a408ad4de248660f3 2026-04-19 14:48:45,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:48:45,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2483a408ad4de248660f3 HTTP/1.1" 200 None 2026-04-19 14:48:45,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:48:45,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:48:45,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:48:45,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2483a408ad4de248660f3 HTTP/1.1" 200 None 2026-04-19 14:48:45,392 - lava_callback - ERROR - Error processing callback for node 69e2483a408ad4de248660f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:49:45,305 - lava_callback - INFO - Received callback for node 69e24882408ad4de2486610d INFO: 172.21.0.1:44812 - "POST /node/69e24882408ad4de2486610d HTTP/1.0" 202 Accepted 2026-04-19 14:49:45,311 - lava_callback - INFO - Starting async job submit for node 69e24882408ad4de2486610d 2026-04-19 14:49:45,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:49:45,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24882408ad4de2486610d HTTP/1.1" 200 None 2026-04-19 14:49:45,326 - lava_callback - DEBUG - Processing node 69e24882408ad4de2486610d: baseline-arm-clabbe 2026-04-19 14:49:45,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24882408ad4de2486610d 2026-04-19 14:49:45,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:49:45,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24882408ad4de2486610d HTTP/1.1" 200 None 2026-04-19 14:49:45,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:49:45,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 14:49:45,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:49:45,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24882408ad4de2486610d HTTP/1.1" 200 None 2026-04-19 14:49:45,387 - lava_callback - ERROR - Error processing callback for node 69e24882408ad4de2486610d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:50:14,471 - lava_callback - INFO - Received callback for node 69e248a2408ad4de2486611b INFO: 172.21.0.1:39128 - "POST /node/69e248a2408ad4de2486611b HTTP/1.0" 202 Accepted 2026-04-19 14:50:14,477 - lava_callback - INFO - Starting async job submit for node 69e248a2408ad4de2486611b 2026-04-19 14:50:14,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:50:14,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e248a2408ad4de2486611b HTTP/1.1" 200 None 2026-04-19 14:50:14,498 - lava_callback - DEBUG - Processing node 69e248a2408ad4de2486611b: baseline-arm-baylibre 2026-04-19 14:50:14,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e248a2408ad4de2486611b 2026-04-19 14:50:14,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:50:14,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e248a2408ad4de2486611b HTTP/1.1" 200 None 2026-04-19 14:50:14,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:50:14,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:50:14,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:50:14,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e248a2408ad4de2486611b HTTP/1.1" 200 None 2026-04-19 14:50:14,559 - lava_callback - ERROR - Error processing callback for node 69e248a2408ad4de2486611b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:51:34,402 - lava_callback - INFO - Received callback for node 69e248ea408ad4de24866133 INFO: 172.21.0.1:58478 - "POST /node/69e248ea408ad4de24866133 HTTP/1.0" 202 Accepted 2026-04-19 14:51:34,407 - lava_callback - INFO - Starting async job submit for node 69e248ea408ad4de24866133 2026-04-19 14:51:34,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:51:34,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e248ea408ad4de24866133 HTTP/1.1" 200 None 2026-04-19 14:51:34,423 - lava_callback - DEBUG - Processing node 69e248ea408ad4de24866133: baseline-arm-baylibre 2026-04-19 14:51:34,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e248ea408ad4de24866133 2026-04-19 14:51:34,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:51:34,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e248ea408ad4de24866133 HTTP/1.1" 200 None 2026-04-19 14:51:34,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:51:34,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:51:34,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:51:34,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e248ea408ad4de24866133 HTTP/1.1" 200 None 2026-04-19 14:51:34,484 - lava_callback - ERROR - Error processing callback for node 69e248ea408ad4de24866133: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:52:14,379 - lava_callback - INFO - Received callback for node 69e2490f408ad4de24866142 INFO: 172.21.0.1:41254 - "POST /node/69e2490f408ad4de24866142 HTTP/1.0" 202 Accepted 2026-04-19 14:52:14,388 - lava_callback - INFO - Starting async job submit for node 69e2490f408ad4de24866142 2026-04-19 14:52:14,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:52:14,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2490f408ad4de24866142 HTTP/1.1" 200 None 2026-04-19 14:52:14,410 - lava_callback - DEBUG - Processing node 69e2490f408ad4de24866142: baseline-arm-baylibre 2026-04-19 14:52:14,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2490f408ad4de24866142 2026-04-19 14:52:14,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:52:14,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2490f408ad4de24866142 HTTP/1.1" 200 None 2026-04-19 14:52:14,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:52:14,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:52:14,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:52:14,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2490f408ad4de24866142 HTTP/1.1" 200 None 2026-04-19 14:52:14,496 - lava_callback - ERROR - Error processing callback for node 69e2490f408ad4de24866142: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:52:54,473 - lava_callback - INFO - Received callback for node 69e24933408ad4de24866154 INFO: 172.21.0.1:58558 - "POST /node/69e24933408ad4de24866154 HTTP/1.0" 202 Accepted 2026-04-19 14:52:54,479 - lava_callback - INFO - Starting async job submit for node 69e24933408ad4de24866154 2026-04-19 14:52:54,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:52:54,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24933408ad4de24866154 HTTP/1.1" 200 None 2026-04-19 14:52:54,494 - lava_callback - DEBUG - Processing node 69e24933408ad4de24866154: baseline-arm-baylibre 2026-04-19 14:52:54,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24933408ad4de24866154 2026-04-19 14:52:54,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:52:54,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24933408ad4de24866154 HTTP/1.1" 200 None 2026-04-19 14:52:54,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:52:54,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:52:54,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:52:54,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24933408ad4de24866154 HTTP/1.1" 200 None 2026-04-19 14:52:54,543 - lava_callback - ERROR - Error processing callback for node 69e24933408ad4de24866154: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:54:45,544 - lava_callback - INFO - Received callback for node 69e249a4408ad4de24866178 INFO: 172.21.0.1:47772 - "POST /node/69e249a4408ad4de24866178 HTTP/1.0" 202 Accepted 2026-04-19 14:54:45,552 - lava_callback - INFO - Starting async job submit for node 69e249a4408ad4de24866178 2026-04-19 14:54:45,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:54:45,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e249a4408ad4de24866178 HTTP/1.1" 200 None 2026-04-19 14:54:45,573 - lava_callback - DEBUG - Processing node 69e249a4408ad4de24866178: baseline-arm-clabbe 2026-04-19 14:54:45,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e249a4408ad4de24866178 2026-04-19 14:54:45,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:54:45,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e249a4408ad4de24866178 HTTP/1.1" 200 None 2026-04-19 14:54:45,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:54:45,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:54:45,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:54:45,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e249a4408ad4de24866178 HTTP/1.1" 200 None 2026-04-19 14:54:45,632 - lava_callback - ERROR - Error processing callback for node 69e249a4408ad4de24866178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:55:25,555 - lava_callback - INFO - Received callback for node 69e249c9408ad4de2486618b INFO: 172.21.0.1:58270 - "POST /node/69e249c9408ad4de2486618b HTTP/1.0" 202 Accepted 2026-04-19 14:55:25,561 - lava_callback - INFO - Starting async job submit for node 69e249c9408ad4de2486618b 2026-04-19 14:55:25,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:55:25,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e249c9408ad4de2486618b HTTP/1.1" 200 None 2026-04-19 14:55:25,588 - lava_callback - DEBUG - Processing node 69e249c9408ad4de2486618b: baseline-arm-clabbe 2026-04-19 14:55:25,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e249c9408ad4de2486618b 2026-04-19 14:55:25,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:55:25,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e249c9408ad4de2486618b HTTP/1.1" 200 None 2026-04-19 14:55:25,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:55:25,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:55:25,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:55:25,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e249c9408ad4de2486618b HTTP/1.1" 200 None 2026-04-19 14:55:25,636 - lava_callback - ERROR - Error processing callback for node 69e249c9408ad4de2486618b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:55:45,628 - lava_callback - INFO - Received callback for node 69e249ee408ad4de24866196 INFO: 172.21.0.1:47568 - "POST /node/69e249ee408ad4de24866196 HTTP/1.0" 202 Accepted 2026-04-19 14:55:45,633 - lava_callback - INFO - Starting async job submit for node 69e249ee408ad4de24866196 2026-04-19 14:55:45,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:55:45,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e249ee408ad4de24866196 HTTP/1.1" 200 None 2026-04-19 14:55:45,660 - lava_callback - DEBUG - Processing node 69e249ee408ad4de24866196: baseline-arm-clabbe 2026-04-19 14:55:45,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e249ee408ad4de24866196 2026-04-19 14:55:45,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:55:45,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e249ee408ad4de24866196 HTTP/1.1" 200 None 2026-04-19 14:55:45,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:55:45,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:55:45,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:55:45,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e249ee408ad4de24866196 HTTP/1.1" 200 None 2026-04-19 14:55:45,708 - lava_callback - ERROR - Error processing callback for node 69e249ee408ad4de24866196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:56:25,568 - lava_callback - INFO - Received callback for node 69e24a13408ad4de248661a3 INFO: 172.21.0.1:56420 - "POST /node/69e24a13408ad4de248661a3 HTTP/1.0" 202 Accepted 2026-04-19 14:56:25,575 - lava_callback - INFO - Starting async job submit for node 69e24a13408ad4de248661a3 2026-04-19 14:56:25,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:56:25,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24a13408ad4de248661a3 HTTP/1.1" 200 None 2026-04-19 14:56:25,593 - lava_callback - DEBUG - Processing node 69e24a13408ad4de248661a3: baseline-arm-clabbe 2026-04-19 14:56:25,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24a13408ad4de248661a3 2026-04-19 14:56:25,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:56:25,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24a13408ad4de248661a3 HTTP/1.1" 200 None 2026-04-19 14:56:25,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:56:25,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:56:25,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:56:25,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24a13408ad4de248661a3 HTTP/1.1" 200 None 2026-04-19 14:56:25,649 - lava_callback - ERROR - Error processing callback for node 69e24a13408ad4de248661a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:57:05,622 - lava_callback - INFO - Received callback for node 69e24a38408ad4de248661b2 INFO: 172.21.0.1:34606 - "POST /node/69e24a38408ad4de248661b2 HTTP/1.0" 202 Accepted 2026-04-19 14:57:05,631 - lava_callback - INFO - Starting async job submit for node 69e24a38408ad4de248661b2 2026-04-19 14:57:05,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:57:05,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24a38408ad4de248661b2 HTTP/1.1" 200 None 2026-04-19 14:57:05,658 - lava_callback - DEBUG - Processing node 69e24a38408ad4de248661b2: baseline-arm-clabbe 2026-04-19 14:57:05,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24a38408ad4de248661b2 2026-04-19 14:57:05,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:57:05,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24a38408ad4de248661b2 HTTP/1.1" 200 None 2026-04-19 14:57:05,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:57:05,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:57:05,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:57:05,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24a38408ad4de248661b2 HTTP/1.1" 200 None 2026-04-19 14:57:05,708 - lava_callback - ERROR - Error processing callback for node 69e24a38408ad4de248661b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:57:45,636 - lava_callback - INFO - Received callback for node 69e24a5c408ad4de248661c3 INFO: 172.21.0.1:33474 - "POST /node/69e24a5c408ad4de248661c3 HTTP/1.0" 202 Accepted 2026-04-19 14:57:45,643 - lava_callback - INFO - Starting async job submit for node 69e24a5c408ad4de248661c3 2026-04-19 14:57:45,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:57:45,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24a5c408ad4de248661c3 HTTP/1.1" 200 None 2026-04-19 14:57:45,658 - lava_callback - DEBUG - Processing node 69e24a5c408ad4de248661c3: baseline-arm-clabbe 2026-04-19 14:57:45,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24a5c408ad4de248661c3 2026-04-19 14:57:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:57:45,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24a5c408ad4de248661c3 HTTP/1.1" 200 None 2026-04-19 14:57:45,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:57:45,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:57:45,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:57:45,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24a5c408ad4de248661c3 HTTP/1.1" 200 None 2026-04-19 14:57:45,709 - lava_callback - ERROR - Error processing callback for node 69e24a5c408ad4de248661c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:58:25,682 - lava_callback - INFO - Received callback for node 69e24a82408ad4de248661d4 INFO: 172.21.0.1:45780 - "POST /node/69e24a82408ad4de248661d4 HTTP/1.0" 202 Accepted 2026-04-19 14:58:25,687 - lava_callback - INFO - Starting async job submit for node 69e24a82408ad4de248661d4 2026-04-19 14:58:25,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:58:25,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24a82408ad4de248661d4 HTTP/1.1" 200 None 2026-04-19 14:58:25,725 - lava_callback - DEBUG - Processing node 69e24a82408ad4de248661d4: baseline-arm-clabbe 2026-04-19 14:58:25,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24a82408ad4de248661d4 2026-04-19 14:58:25,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:58:25,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24a82408ad4de248661d4 HTTP/1.1" 200 None 2026-04-19 14:58:25,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:58:25,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:58:25,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:58:25,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24a82408ad4de248661d4 HTTP/1.1" 200 None 2026-04-19 14:58:25,803 - lava_callback - ERROR - Error processing callback for node 69e24a82408ad4de248661d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:59:05,648 - lava_callback - INFO - Received callback for node 69e24aa6408ad4de248661e3 INFO: 172.21.0.1:44348 - "POST /node/69e24aa6408ad4de248661e3 HTTP/1.0" 202 Accepted 2026-04-19 14:59:05,654 - lava_callback - INFO - Starting async job submit for node 69e24aa6408ad4de248661e3 2026-04-19 14:59:05,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:59:05,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24aa6408ad4de248661e3 HTTP/1.1" 200 None 2026-04-19 14:59:05,691 - lava_callback - DEBUG - Processing node 69e24aa6408ad4de248661e3: baseline-arm-clabbe 2026-04-19 14:59:05,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24aa6408ad4de248661e3 2026-04-19 14:59:05,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:59:05,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24aa6408ad4de248661e3 HTTP/1.1" 200 None 2026-04-19 14:59:05,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:59:05,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:59:05,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:59:05,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24aa6408ad4de248661e3 HTTP/1.1" 200 None 2026-04-19 14:59:05,753 - lava_callback - ERROR - Error processing callback for node 69e24aa6408ad4de248661e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK 2026-04-19 14:59:45,914 - lava_callback - INFO - Received callback for node 69e24acf408ad4de248661f5 INFO: 172.21.0.1:54254 - "POST /node/69e24acf408ad4de248661f5 HTTP/1.0" 202 Accepted 2026-04-19 14:59:45,923 - lava_callback - INFO - Starting async job submit for node 69e24acf408ad4de248661f5 2026-04-19 14:59:45,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:59:45,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24acf408ad4de248661f5 HTTP/1.1" 200 None 2026-04-19 14:59:45,946 - lava_callback - DEBUG - Processing node 69e24acf408ad4de248661f5: baseline-arm-clabbe 2026-04-19 14:59:45,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24acf408ad4de248661f5 2026-04-19 14:59:45,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:59:45,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24acf408ad4de248661f5 HTTP/1.1" 200 None 2026-04-19 14:59:45,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:59:45,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec5f408ad4de24863c39 HTTP/1.1" 200 None 2026-04-19 14:59:45,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 14:59:46,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24acf408ad4de248661f5 HTTP/1.1" 200 None 2026-04-19 14:59:46,003 - lava_callback - ERROR - Error processing callback for node 69e24acf408ad4de248661f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:00:25,757 - lava_callback - INFO - Received callback for node 69e24af4408ad4de24866207 INFO: 172.21.0.1:44408 - "POST /node/69e24af4408ad4de24866207 HTTP/1.0" 202 Accepted 2026-04-19 15:00:25,762 - lava_callback - INFO - Starting async job submit for node 69e24af4408ad4de24866207 2026-04-19 15:00:25,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:00:25,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24af4408ad4de24866207 HTTP/1.1" 200 None 2026-04-19 15:00:25,779 - lava_callback - DEBUG - Processing node 69e24af4408ad4de24866207: baseline-arm-clabbe 2026-04-19 15:00:25,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24af4408ad4de24866207 2026-04-19 15:00:25,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:00:25,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24af4408ad4de24866207 HTTP/1.1" 200 None 2026-04-19 15:00:25,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:00:25,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 15:00:25,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:00:25,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24af4408ad4de24866207 HTTP/1.1" 200 None 2026-04-19 15:00:25,843 - lava_callback - ERROR - Error processing callback for node 69e24af4408ad4de24866207: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:00:45,786 - lava_callback - INFO - Received callback for node 69e24b1a408ad4de24866212 INFO: 172.21.0.1:45176 - "POST /node/69e24b1a408ad4de24866212 HTTP/1.0" 202 Accepted 2026-04-19 15:00:45,792 - lava_callback - INFO - Starting async job submit for node 69e24b1a408ad4de24866212 2026-04-19 15:00:45,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:00:45,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24b1a408ad4de24866212 HTTP/1.1" 200 None 2026-04-19 15:00:45,807 - lava_callback - DEBUG - Processing node 69e24b1a408ad4de24866212: baseline-arm-clabbe 2026-04-19 15:00:45,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24b1a408ad4de24866212 2026-04-19 15:00:45,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:00:45,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24b1a408ad4de24866212 HTTP/1.1" 200 None 2026-04-19 15:00:45,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:00:45,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 15:00:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:00:45,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24b1a408ad4de24866212 HTTP/1.1" 200 None 2026-04-19 15:00:45,861 - lava_callback - ERROR - Error processing callback for node 69e24b1a408ad4de24866212: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:01:25,796 - lava_callback - INFO - Received callback for node 69e24b3f408ad4de2486621f INFO: 172.21.0.1:46452 - "POST /node/69e24b3f408ad4de2486621f HTTP/1.0" 202 Accepted 2026-04-19 15:01:25,803 - lava_callback - INFO - Starting async job submit for node 69e24b3f408ad4de2486621f 2026-04-19 15:01:25,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:01:25,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24b3f408ad4de2486621f HTTP/1.1" 200 None 2026-04-19 15:01:25,818 - lava_callback - DEBUG - Processing node 69e24b3f408ad4de2486621f: baseline-arm-clabbe 2026-04-19 15:01:25,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24b3f408ad4de2486621f 2026-04-19 15:01:25,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:01:25,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24b3f408ad4de2486621f HTTP/1.1" 200 None 2026-04-19 15:01:25,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:01:25,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 15:01:25,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:01:25,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24b3f408ad4de2486621f HTTP/1.1" 200 None 2026-04-19 15:01:25,891 - lava_callback - ERROR - Error processing callback for node 69e24b3f408ad4de2486621f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:02:05,855 - lava_callback - INFO - Received callback for node 69e24b65408ad4de24866230 INFO: 172.21.0.1:48786 - "POST /node/69e24b65408ad4de24866230 HTTP/1.0" 202 Accepted 2026-04-19 15:02:05,861 - lava_callback - INFO - Starting async job submit for node 69e24b65408ad4de24866230 2026-04-19 15:02:05,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:02:05,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24b65408ad4de24866230 HTTP/1.1" 200 None 2026-04-19 15:02:05,876 - lava_callback - DEBUG - Processing node 69e24b65408ad4de24866230: baseline-arm-clabbe 2026-04-19 15:02:05,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24b65408ad4de24866230 2026-04-19 15:02:05,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:02:05,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24b65408ad4de24866230 HTTP/1.1" 200 None 2026-04-19 15:02:05,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:02:05,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 15:02:05,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:02:05,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24b65408ad4de24866230 HTTP/1.1" 200 None 2026-04-19 15:02:05,930 - lava_callback - ERROR - Error processing callback for node 69e24b65408ad4de24866230: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47438 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:02:45,882 - lava_callback - INFO - Received callback for node 69e24b8a408ad4de24866245 INFO: 172.21.0.1:56898 - "POST /node/69e24b8a408ad4de24866245 HTTP/1.0" 202 Accepted 2026-04-19 15:02:45,887 - lava_callback - INFO - Starting async job submit for node 69e24b8a408ad4de24866245 2026-04-19 15:02:45,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:02:45,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24b8a408ad4de24866245 HTTP/1.1" 200 None 2026-04-19 15:02:45,904 - lava_callback - DEBUG - Processing node 69e24b8a408ad4de24866245: baseline-arm-clabbe 2026-04-19 15:02:45,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24b8a408ad4de24866245 2026-04-19 15:02:45,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:02:45,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24b8a408ad4de24866245 HTTP/1.1" 200 None 2026-04-19 15:02:45,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:02:45,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 15:02:45,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:02:45,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24b8a408ad4de24866245 HTTP/1.1" 200 None 2026-04-19 15:02:45,953 - lava_callback - ERROR - Error processing callback for node 69e24b8a408ad4de24866245: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:03:25,936 - lava_callback - INFO - Received callback for node 69e24bae408ad4de24866253 INFO: 172.21.0.1:42228 - "POST /node/69e24bae408ad4de24866253 HTTP/1.0" 202 Accepted 2026-04-19 15:03:25,945 - lava_callback - INFO - Starting async job submit for node 69e24bae408ad4de24866253 2026-04-19 15:03:25,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:03:25,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24bae408ad4de24866253 HTTP/1.1" 200 None 2026-04-19 15:03:25,962 - lava_callback - DEBUG - Processing node 69e24bae408ad4de24866253: baseline-arm-clabbe 2026-04-19 15:03:25,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24bae408ad4de24866253 2026-04-19 15:03:25,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:03:25,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24bae408ad4de24866253 HTTP/1.1" 200 None 2026-04-19 15:03:25,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:03:25,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-19 15:03:25,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:03:26,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24bae408ad4de24866253 HTTP/1.1" 200 None 2026-04-19 15:03:26,015 - lava_callback - ERROR - Error processing callback for node 69e24bae408ad4de24866253: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:03:55,034 - lava_callback - INFO - Received callback for node 69e24bd8408ad4de24866261 INFO: 172.21.0.1:40838 - "POST /node/69e24bd8408ad4de24866261 HTTP/1.0" 202 Accepted 2026-04-19 15:03:55,039 - lava_callback - INFO - Starting async job submit for node 69e24bd8408ad4de24866261 2026-04-19 15:03:55,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:03:55,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24bd8408ad4de24866261 HTTP/1.1" 200 None 2026-04-19 15:03:55,060 - lava_callback - DEBUG - Processing node 69e24bd8408ad4de24866261: baseline-arm64-baylibre 2026-04-19 15:03:55,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24bd8408ad4de24866261 2026-04-19 15:03:55,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:03:55,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24bd8408ad4de24866261 HTTP/1.1" 200 None 2026-04-19 15:03:55,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:03:55,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:03:55,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:03:55,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24bd8408ad4de24866261 HTTP/1.1" 200 None 2026-04-19 15:03:55,117 - lava_callback - ERROR - Error processing callback for node 69e24bd8408ad4de24866261: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:05:15,088 - lava_callback - INFO - Received callback for node 69e24c27408ad4de24866287 INFO: 172.21.0.1:43378 - "POST /node/69e24c27408ad4de24866287 HTTP/1.0" 202 Accepted 2026-04-19 15:05:15,094 - lava_callback - INFO - Starting async job submit for node 69e24c27408ad4de24866287 2026-04-19 15:05:15,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:05:15,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24c27408ad4de24866287 HTTP/1.1" 200 None 2026-04-19 15:05:15,114 - lava_callback - DEBUG - Processing node 69e24c27408ad4de24866287: baseline-arm64-baylibre 2026-04-19 15:05:15,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24c27408ad4de24866287 2026-04-19 15:05:15,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:05:15,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24c27408ad4de24866287 HTTP/1.1" 200 None 2026-04-19 15:05:15,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:05:15,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:05:15,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43392 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 15:05:15,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24c27408ad4de24866287 HTTP/1.1" 200 None 2026-04-19 15:05:15,172 - lava_callback - ERROR - Error processing callback for node 69e24c27408ad4de24866287: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:06:35,161 - lava_callback - INFO - Received callback for node 69e24c76408ad4de248662a5 INFO: 172.21.0.1:40670 - "POST /node/69e24c76408ad4de248662a5 HTTP/1.0" 202 Accepted 2026-04-19 15:06:35,166 - lava_callback - INFO - Starting async job submit for node 69e24c76408ad4de248662a5 2026-04-19 15:06:35,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:06:35,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24c76408ad4de248662a5 HTTP/1.1" 200 None 2026-04-19 15:06:35,182 - lava_callback - DEBUG - Processing node 69e24c76408ad4de248662a5: baseline-arm64-baylibre 2026-04-19 15:06:35,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24c76408ad4de248662a5 2026-04-19 15:06:35,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:06:35,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24c76408ad4de248662a5 HTTP/1.1" 200 None 2026-04-19 15:06:35,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:06:35,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:06:35,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:06:35,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24c76408ad4de248662a5 HTTP/1.1" 200 None 2026-04-19 15:06:35,229 - lava_callback - ERROR - Error processing callback for node 69e24c76408ad4de248662a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:07:55,207 - lava_callback - INFO - Received callback for node 69e24cc6408ad4de248662c6 INFO: 172.21.0.1:44600 - "POST /node/69e24cc6408ad4de248662c6 HTTP/1.0" 202 Accepted 2026-04-19 15:07:55,212 - lava_callback - INFO - Starting async job submit for node 69e24cc6408ad4de248662c6 2026-04-19 15:07:55,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:07:55,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24cc6408ad4de248662c6 HTTP/1.1" 200 None 2026-04-19 15:07:55,230 - lava_callback - DEBUG - Processing node 69e24cc6408ad4de248662c6: baseline-arm64-baylibre 2026-04-19 15:07:55,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24cc6408ad4de248662c6 2026-04-19 15:07:55,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:07:55,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24cc6408ad4de248662c6 HTTP/1.1" 200 None 2026-04-19 15:07:55,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:07:55,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:07:55,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:07:55,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24cc6408ad4de248662c6 HTTP/1.1" 200 None 2026-04-19 15:07:55,278 - lava_callback - ERROR - Error processing callback for node 69e24cc6408ad4de248662c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-19 15:09:15,326 - lava_callback - INFO - Received callback for node 69e24d14408ad4de248662f7 INFO: 172.21.0.1:60056 - "POST /node/69e24d14408ad4de248662f7 HTTP/1.0" 202 Accepted 2026-04-19 15:09:15,332 - lava_callback - INFO - Starting async job submit for node 69e24d14408ad4de248662f7 2026-04-19 15:09:15,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:09:15,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24d14408ad4de248662f7 HTTP/1.1" 200 None 2026-04-19 15:09:15,350 - lava_callback - DEBUG - Processing node 69e24d14408ad4de248662f7: baseline-arm64-baylibre 2026-04-19 15:09:15,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24d14408ad4de248662f7 2026-04-19 15:09:15,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:09:15,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24d14408ad4de248662f7 HTTP/1.1" 200 None 2026-04-19 15:09:15,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:09:15,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:09:15,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:09:15,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24d14408ad4de248662f7 HTTP/1.1" 200 None 2026-04-19 15:09:15,398 - lava_callback - ERROR - Error processing callback for node 69e24d14408ad4de248662f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:10:35,331 - lava_callback - INFO - Received callback for node 69e24d63408ad4de24866339 INFO: 172.21.0.1:53062 - "POST /node/69e24d63408ad4de24866339 HTTP/1.0" 202 Accepted 2026-04-19 15:10:35,337 - lava_callback - INFO - Starting async job submit for node 69e24d63408ad4de24866339 2026-04-19 15:10:35,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:10:35,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24d63408ad4de24866339 HTTP/1.1" 200 None 2026-04-19 15:10:35,353 - lava_callback - DEBUG - Processing node 69e24d63408ad4de24866339: baseline-arm64-baylibre 2026-04-19 15:10:35,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24d63408ad4de24866339 2026-04-19 15:10:35,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:10:35,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24d63408ad4de24866339 HTTP/1.1" 200 None 2026-04-19 15:10:35,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:10:35,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:10:35,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:10:35,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24d63408ad4de24866339 HTTP/1.1" 200 None 2026-04-19 15:10:35,414 - lava_callback - ERROR - Error processing callback for node 69e24d63408ad4de24866339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:13:06,314 - lava_callback - INFO - Received callback for node 69e24dfc408ad4de24866364 INFO: 172.21.0.1:55222 - "POST /node/69e24dfc408ad4de24866364 HTTP/1.0" 202 Accepted 2026-04-19 15:13:06,320 - lava_callback - INFO - Starting async job submit for node 69e24dfc408ad4de24866364 2026-04-19 15:13:06,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:13:06,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24dfc408ad4de24866364 HTTP/1.1" 200 None 2026-04-19 15:13:06,335 - lava_callback - DEBUG - Processing node 69e24dfc408ad4de24866364: baseline-arm64-clabbe 2026-04-19 15:13:06,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24dfc408ad4de24866364 2026-04-19 15:13:06,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:13:06,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24dfc408ad4de24866364 HTTP/1.1" 200 None 2026-04-19 15:13:06,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:13:06,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:13:06,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:13:06,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24dfc408ad4de24866364 HTTP/1.1" 200 None 2026-04-19 15:13:06,388 - lava_callback - ERROR - Error processing callback for node 69e24dfc408ad4de24866364: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:15:46,447 - lava_callback - INFO - Received callback for node 69e24e90408ad4de24866392 INFO: 172.21.0.1:34670 - "POST /node/69e24e90408ad4de24866392 HTTP/1.0" 202 Accepted 2026-04-19 15:15:46,453 - lava_callback - INFO - Starting async job submit for node 69e24e90408ad4de24866392 2026-04-19 15:15:46,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:15:46,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24e90408ad4de24866392 HTTP/1.1" 200 None 2026-04-19 15:15:46,468 - lava_callback - DEBUG - Processing node 69e24e90408ad4de24866392: baseline-arm64-clabbe 2026-04-19 15:15:46,469 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24e90408ad4de24866392 2026-04-19 15:15:46,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:15:46,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24e90408ad4de24866392 HTTP/1.1" 200 None 2026-04-19 15:15:46,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:15:46,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:15:46,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:15:46,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24e90408ad4de24866392 HTTP/1.1" 200 None 2026-04-19 15:15:46,516 - lava_callback - ERROR - Error processing callback for node 69e24e90408ad4de24866392: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42388 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:17:06,467 - lava_callback - INFO - Received callback for node 69e24ee0408ad4de248663b8 INFO: 172.21.0.1:33396 - "POST /node/69e24ee0408ad4de248663b8 HTTP/1.0" 202 Accepted 2026-04-19 15:17:06,473 - lava_callback - INFO - Starting async job submit for node 69e24ee0408ad4de248663b8 2026-04-19 15:17:06,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:17:06,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24ee0408ad4de248663b8 HTTP/1.1" 200 None 2026-04-19 15:17:06,489 - lava_callback - DEBUG - Processing node 69e24ee0408ad4de248663b8: baseline-arm64-clabbe 2026-04-19 15:17:06,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24ee0408ad4de248663b8 2026-04-19 15:17:06,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:17:06,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24ee0408ad4de248663b8 HTTP/1.1" 200 None 2026-04-19 15:17:06,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33410 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:17:06,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:17:06,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:17:06,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24ee0408ad4de248663b8 HTTP/1.1" 200 None 2026-04-19 15:17:06,544 - lava_callback - ERROR - Error processing callback for node 69e24ee0408ad4de248663b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:18:26,511 - lava_callback - INFO - Received callback for node 69e24f31408ad4de248663dd INFO: 172.21.0.1:37070 - "POST /node/69e24f31408ad4de248663dd HTTP/1.0" 202 Accepted 2026-04-19 15:18:26,521 - lava_callback - INFO - Starting async job submit for node 69e24f31408ad4de248663dd 2026-04-19 15:18:26,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:18:26,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24f31408ad4de248663dd HTTP/1.1" 200 None 2026-04-19 15:18:26,543 - lava_callback - DEBUG - Processing node 69e24f31408ad4de248663dd: baseline-arm64-clabbe 2026-04-19 15:18:26,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24f31408ad4de248663dd 2026-04-19 15:18:26,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:18:26,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24f31408ad4de248663dd HTTP/1.1" 200 None 2026-04-19 15:18:26,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:18:26,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:18:26,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:18:26,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24f31408ad4de248663dd HTTP/1.1" 200 None 2026-04-19 15:18:26,623 - lava_callback - ERROR - Error processing callback for node 69e24f31408ad4de248663dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:19:55,831 - lava_callback - INFO - Received callback for node 69e24f8e408ad4de248663f8 INFO: 172.21.0.1:39756 - "POST /node/69e24f8e408ad4de248663f8 HTTP/1.0" 202 Accepted 2026-04-19 15:19:55,839 - lava_callback - INFO - Starting async job submit for node 69e24f8e408ad4de248663f8 2026-04-19 15:19:55,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:19:55,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24f8e408ad4de248663f8 HTTP/1.1" 200 None 2026-04-19 15:19:55,856 - lava_callback - DEBUG - Processing node 69e24f8e408ad4de248663f8: baseline-arm64-baylibre 2026-04-19 15:19:55,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24f8e408ad4de248663f8 2026-04-19 15:19:55,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:19:55,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24f8e408ad4de248663f8 HTTP/1.1" 200 None 2026-04-19 15:19:55,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:19:55,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:19:55,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:19:55,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24f8e408ad4de248663f8 HTTP/1.1" 200 None 2026-04-19 15:19:55,928 - lava_callback - ERROR - Error processing callback for node 69e24f8e408ad4de248663f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:21:26,677 - lava_callback - INFO - Received callback for node 69e24ff4408ad4de2486641a INFO: 172.21.0.1:41000 - "POST /node/69e24ff4408ad4de2486641a HTTP/1.0" 202 Accepted 2026-04-19 15:21:26,682 - lava_callback - INFO - Starting async job submit for node 69e24ff4408ad4de2486641a 2026-04-19 15:21:26,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:21:26,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24ff4408ad4de2486641a HTTP/1.1" 200 None 2026-04-19 15:21:26,700 - lava_callback - DEBUG - Processing node 69e24ff4408ad4de2486641a: baseline-arm64-clabbe 2026-04-19 15:21:26,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e24ff4408ad4de2486641a 2026-04-19 15:21:26,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:21:26,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e24ff4408ad4de2486641a HTTP/1.1" 200 None 2026-04-19 15:21:26,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:21:26,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:21:26,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:21:26,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e24ff4408ad4de2486641a HTTP/1.1" 200 None 2026-04-19 15:21:26,747 - lava_callback - ERROR - Error processing callback for node 69e24ff4408ad4de2486641a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59674 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:22:56,002 - lava_callback - INFO - Received callback for node 69e2503c408ad4de24866439 INFO: 172.21.0.1:42746 - "POST /node/69e2503c408ad4de24866439 HTTP/1.0" 202 Accepted 2026-04-19 15:22:56,008 - lava_callback - INFO - Starting async job submit for node 69e2503c408ad4de24866439 2026-04-19 15:22:56,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:22:56,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2503c408ad4de24866439 HTTP/1.1" 200 None 2026-04-19 15:22:56,030 - lava_callback - DEBUG - Processing node 69e2503c408ad4de24866439: baseline-arm64-baylibre 2026-04-19 15:22:56,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2503c408ad4de24866439 2026-04-19 15:22:56,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:22:56,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2503c408ad4de24866439 HTTP/1.1" 200 None 2026-04-19 15:22:56,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:22:56,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:22:56,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:22:56,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2503c408ad4de24866439 HTTP/1.1" 200 None 2026-04-19 15:22:56,087 - lava_callback - ERROR - Error processing callback for node 69e2503c408ad4de24866439: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:24:26,739 - lava_callback - INFO - Received callback for node 69e2509a408ad4de2486645c INFO: 172.21.0.1:34244 - "POST /node/69e2509a408ad4de2486645c HTTP/1.0" 202 Accepted 2026-04-19 15:24:26,744 - lava_callback - INFO - Starting async job submit for node 69e2509a408ad4de2486645c 2026-04-19 15:24:26,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:24:26,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2509a408ad4de2486645c HTTP/1.1" 200 None 2026-04-19 15:24:26,761 - lava_callback - DEBUG - Processing node 69e2509a408ad4de2486645c: baseline-arm64-clabbe 2026-04-19 15:24:26,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2509a408ad4de2486645c 2026-04-19 15:24:26,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:24:26,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2509a408ad4de2486645c HTTP/1.1" 200 None 2026-04-19 15:24:26,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:24:26,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:24:26,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:24:26,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2509a408ad4de2486645c HTTP/1.1" 200 None 2026-04-19 15:24:26,811 - lava_callback - ERROR - Error processing callback for node 69e2509a408ad4de2486645c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:27:26,882 - lava_callback - INFO - Received callback for node 69e2514f408ad4de24866495 INFO: 172.21.0.1:38922 - "POST /node/69e2514f408ad4de24866495 HTTP/1.0" 202 Accepted 2026-04-19 15:27:26,890 - lava_callback - INFO - Starting async job submit for node 69e2514f408ad4de24866495 2026-04-19 15:27:26,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:27:26,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2514f408ad4de24866495 HTTP/1.1" 200 None 2026-04-19 15:27:26,908 - lava_callback - DEBUG - Processing node 69e2514f408ad4de24866495: baseline-arm64-clabbe 2026-04-19 15:27:26,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2514f408ad4de24866495 2026-04-19 15:27:26,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:27:26,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2514f408ad4de24866495 HTTP/1.1" 200 None 2026-04-19 15:27:26,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:27:26,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:27:26,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:27:26,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2514f408ad4de24866495 HTTP/1.1" 200 None 2026-04-19 15:27:26,966 - lava_callback - ERROR - Error processing callback for node 69e2514f408ad4de24866495: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:28:36,324 - lava_callback - INFO - Received callback for node 69e2519b408ad4de248664ad INFO: 172.21.0.1:51622 - "POST /node/69e2519b408ad4de248664ad HTTP/1.0" 202 Accepted 2026-04-19 15:28:36,330 - lava_callback - INFO - Starting async job submit for node 69e2519b408ad4de248664ad 2026-04-19 15:28:36,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:28:36,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2519b408ad4de248664ad HTTP/1.1" 200 None 2026-04-19 15:28:36,346 - lava_callback - DEBUG - Processing node 69e2519b408ad4de248664ad: baseline-arm64-baylibre 2026-04-19 15:28:36,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2519b408ad4de248664ad 2026-04-19 15:28:36,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:28:36,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2519b408ad4de248664ad HTTP/1.1" 200 None 2026-04-19 15:28:36,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:28:36,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:28:36,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:28:36,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2519b408ad4de248664ad HTTP/1.1" 200 None 2026-04-19 15:28:36,392 - lava_callback - ERROR - Error processing callback for node 69e2519b408ad4de248664ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:29:56,382 - lava_callback - INFO - Received callback for node 69e251f0408ad4de248664cc INFO: 172.21.0.1:44834 - "POST /node/69e251f0408ad4de248664cc HTTP/1.0" 202 Accepted 2026-04-19 15:29:56,390 - lava_callback - INFO - Starting async job submit for node 69e251f0408ad4de248664cc 2026-04-19 15:29:56,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:29:56,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e251f0408ad4de248664cc HTTP/1.1" 200 None 2026-04-19 15:29:56,410 - lava_callback - DEBUG - Processing node 69e251f0408ad4de248664cc: baseline-arm64-baylibre 2026-04-19 15:29:56,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e251f0408ad4de248664cc 2026-04-19 15:29:56,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:29:56,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e251f0408ad4de248664cc HTTP/1.1" 200 None 2026-04-19 15:29:56,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:29:56,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:29:56,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:29:56,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e251f0408ad4de248664cc HTTP/1.1" 200 None 2026-04-19 15:29:56,481 - lava_callback - ERROR - Error processing callback for node 69e251f0408ad4de248664cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:37:16,997 - lava_callback - INFO - Received callback for node 69e2539c408ad4de24866567 INFO: 172.21.0.1:60718 - "POST /node/69e2539c408ad4de24866567 HTTP/1.0" 202 Accepted 2026-04-19 15:37:17,006 - lava_callback - INFO - Starting async job submit for node 69e2539c408ad4de24866567 2026-04-19 15:37:17,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:37:17,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2539c408ad4de24866567 HTTP/1.1" 200 None 2026-04-19 15:37:17,030 - lava_callback - DEBUG - Processing node 69e2539c408ad4de24866567: baseline-arm64-baylibre 2026-04-19 15:37:17,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2539c408ad4de24866567 2026-04-19 15:37:17,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:37:17,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2539c408ad4de24866567 HTTP/1.1" 200 None 2026-04-19 15:37:17,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:37:17,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:37:17,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:37:17,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2539c408ad4de24866567 HTTP/1.1" 200 None 2026-04-19 15:37:17,094 - lava_callback - ERROR - Error processing callback for node 69e2539c408ad4de24866567: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:38:36,877 - lava_callback - INFO - Received callback for node 69e253ee408ad4de24866587 INFO: 172.21.0.1:49948 - "POST /node/69e253ee408ad4de24866587 HTTP/1.0" 202 Accepted 2026-04-19 15:38:36,883 - lava_callback - INFO - Starting async job submit for node 69e253ee408ad4de24866587 2026-04-19 15:38:36,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:38:36,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e253ee408ad4de24866587 HTTP/1.1" 200 None 2026-04-19 15:38:36,901 - lava_callback - DEBUG - Processing node 69e253ee408ad4de24866587: baseline-arm64-baylibre 2026-04-19 15:38:36,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e253ee408ad4de24866587 2026-04-19 15:38:36,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:38:36,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e253ee408ad4de24866587 HTTP/1.1" 200 None 2026-04-19 15:38:36,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:38:36,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:38:36,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:38:36,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e253ee408ad4de24866587 HTTP/1.1" 200 None 2026-04-19 15:38:36,961 - lava_callback - ERROR - Error processing callback for node 69e253ee408ad4de24866587: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:39:57,263 - lava_callback - INFO - Received callback for node 69e2543f408ad4de248665a9 INFO: 172.21.0.1:53310 - "POST /node/69e2543f408ad4de248665a9 HTTP/1.0" 202 Accepted 2026-04-19 15:39:57,272 - lava_callback - INFO - Starting async job submit for node 69e2543f408ad4de248665a9 2026-04-19 15:39:57,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:39:57,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2543f408ad4de248665a9 HTTP/1.1" 200 None 2026-04-19 15:39:57,296 - lava_callback - DEBUG - Processing node 69e2543f408ad4de248665a9: baseline-arm64-baylibre 2026-04-19 15:39:57,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2543f408ad4de248665a9 2026-04-19 15:39:57,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:39:57,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2543f408ad4de248665a9 HTTP/1.1" 200 None 2026-04-19 15:39:57,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:39:57,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:39:57,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:39:57,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2543f408ad4de248665a9 HTTP/1.1" 200 None 2026-04-19 15:39:57,365 - lava_callback - ERROR - Error processing callback for node 69e2543f408ad4de248665a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:41:17,067 - lava_callback - INFO - Received callback for node 69e2548f408ad4de248665c3 INFO: 172.21.0.1:46742 - "POST /node/69e2548f408ad4de248665c3 HTTP/1.0" 202 Accepted 2026-04-19 15:41:17,073 - lava_callback - INFO - Starting async job submit for node 69e2548f408ad4de248665c3 2026-04-19 15:41:17,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:41:17,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2548f408ad4de248665c3 HTTP/1.1" 200 None 2026-04-19 15:41:17,089 - lava_callback - DEBUG - Processing node 69e2548f408ad4de248665c3: baseline-arm64-baylibre 2026-04-19 15:41:17,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2548f408ad4de248665c3 2026-04-19 15:41:17,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:41:17,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2548f408ad4de248665c3 HTTP/1.1" 200 None 2026-04-19 15:41:17,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:41:17,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:41:17,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:41:17,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2548f408ad4de248665c3 HTTP/1.1" 200 None 2026-04-19 15:41:17,136 - lava_callback - ERROR - Error processing callback for node 69e2548f408ad4de248665c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:42:37,172 - lava_callback - INFO - Received callback for node 69e254df408ad4de248665e5 INFO: 172.21.0.1:42708 - "POST /node/69e254df408ad4de248665e5 HTTP/1.0" 202 Accepted 2026-04-19 15:42:37,178 - lava_callback - INFO - Starting async job submit for node 69e254df408ad4de248665e5 2026-04-19 15:42:37,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:42:37,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e254df408ad4de248665e5 HTTP/1.1" 200 None 2026-04-19 15:42:37,209 - lava_callback - DEBUG - Processing node 69e254df408ad4de248665e5: baseline-arm64-baylibre 2026-04-19 15:42:37,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e254df408ad4de248665e5 2026-04-19 15:42:37,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:42:37,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e254df408ad4de248665e5 HTTP/1.1" 200 None 2026-04-19 15:42:37,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:42:37,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:42:37,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:42:37,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e254df408ad4de248665e5 HTTP/1.1" 200 None 2026-04-19 15:42:37,280 - lava_callback - ERROR - Error processing callback for node 69e254df408ad4de248665e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:43:57,174 - lava_callback - INFO - Received callback for node 69e2552d408ad4de24866609 INFO: 172.21.0.1:53332 - "POST /node/69e2552d408ad4de24866609 HTTP/1.0" 202 Accepted 2026-04-19 15:43:57,179 - lava_callback - INFO - Starting async job submit for node 69e2552d408ad4de24866609 2026-04-19 15:43:57,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:43:57,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2552d408ad4de24866609 HTTP/1.1" 200 None 2026-04-19 15:43:57,196 - lava_callback - DEBUG - Processing node 69e2552d408ad4de24866609: baseline-arm64-baylibre 2026-04-19 15:43:57,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2552d408ad4de24866609 2026-04-19 15:43:57,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:43:57,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2552d408ad4de24866609 HTTP/1.1" 200 None 2026-04-19 15:43:57,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:43:57,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:43:57,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:43:57,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2552d408ad4de24866609 HTTP/1.1" 200 None 2026-04-19 15:43:57,252 - lava_callback - ERROR - Error processing callback for node 69e2552d408ad4de24866609: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:45:17,590 - lava_callback - INFO - Received callback for node 69e2557a408ad4de24866627 INFO: 172.21.0.1:54782 - "POST /node/69e2557a408ad4de24866627 HTTP/1.0" 202 Accepted 2026-04-19 15:45:17,596 - lava_callback - INFO - Starting async job submit for node 69e2557a408ad4de24866627 2026-04-19 15:45:17,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:45:17,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2557a408ad4de24866627 HTTP/1.1" 200 None 2026-04-19 15:45:17,619 - lava_callback - DEBUG - Processing node 69e2557a408ad4de24866627: baseline-arm64-baylibre 2026-04-19 15:45:17,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2557a408ad4de24866627 2026-04-19 15:45:17,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:45:17,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2557a408ad4de24866627 HTTP/1.1" 200 None 2026-04-19 15:45:17,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:45:17,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:45:17,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:45:17,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2557a408ad4de24866627 HTTP/1.1" 200 None 2026-04-19 15:45:17,692 - lava_callback - ERROR - Error processing callback for node 69e2557a408ad4de24866627: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:46:27,713 - lava_callback - INFO - Received callback for node 69e255ce408ad4de24866647 INFO: 172.21.0.1:58088 - "POST /node/69e255ce408ad4de24866647 HTTP/1.0" 202 Accepted 2026-04-19 15:46:27,719 - lava_callback - INFO - Starting async job submit for node 69e255ce408ad4de24866647 2026-04-19 15:46:27,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:46:27,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e255ce408ad4de24866647 HTTP/1.1" 200 None 2026-04-19 15:46:27,743 - lava_callback - DEBUG - Processing node 69e255ce408ad4de24866647: baseline-arm64-clabbe 2026-04-19 15:46:27,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e255ce408ad4de24866647 2026-04-19 15:46:27,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:46:27,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e255ce408ad4de24866647 HTTP/1.1" 200 None 2026-04-19 15:46:27,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:46:27,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:46:27,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:46:27,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e255ce408ad4de24866647 HTTP/1.1" 200 None 2026-04-19 15:46:27,799 - lava_callback - ERROR - Error processing callback for node 69e255ce408ad4de24866647: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:47:47,730 - lava_callback - INFO - Received callback for node 69e2561c408ad4de2486666d INFO: 172.21.0.1:49458 - "POST /node/69e2561c408ad4de2486666d HTTP/1.0" 202 Accepted 2026-04-19 15:47:47,736 - lava_callback - INFO - Starting async job submit for node 69e2561c408ad4de2486666d 2026-04-19 15:47:47,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:47:47,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2561c408ad4de2486666d HTTP/1.1" 200 None 2026-04-19 15:47:47,751 - lava_callback - DEBUG - Processing node 69e2561c408ad4de2486666d: baseline-arm64-clabbe 2026-04-19 15:47:47,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2561c408ad4de2486666d 2026-04-19 15:47:47,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:47:47,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2561c408ad4de2486666d HTTP/1.1" 200 None 2026-04-19 15:47:47,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:47:47,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:47:47,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:47:47,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2561c408ad4de2486666d HTTP/1.1" 200 None 2026-04-19 15:47:47,812 - lava_callback - ERROR - Error processing callback for node 69e2561c408ad4de2486666d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:49:07,833 - lava_callback - INFO - Received callback for node 69e2566c408ad4de24866687 INFO: 172.21.0.1:43596 - "POST /node/69e2566c408ad4de24866687 HTTP/1.0" 202 Accepted 2026-04-19 15:49:07,841 - lava_callback - INFO - Starting async job submit for node 69e2566c408ad4de24866687 2026-04-19 15:49:07,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:49:07,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2566c408ad4de24866687 HTTP/1.1" 200 None 2026-04-19 15:49:07,858 - lava_callback - DEBUG - Processing node 69e2566c408ad4de24866687: baseline-arm64-clabbe 2026-04-19 15:49:07,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2566c408ad4de24866687 2026-04-19 15:49:07,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:49:07,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2566c408ad4de24866687 HTTP/1.1" 200 None 2026-04-19 15:49:07,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:49:07,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:49:07,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:49:07,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2566c408ad4de24866687 HTTP/1.1" 200 None 2026-04-19 15:49:07,908 - lava_callback - ERROR - Error processing callback for node 69e2566c408ad4de24866687: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:50:27,801 - lava_callback - INFO - Received callback for node 69e256bc408ad4de248666a7 INFO: 172.21.0.1:52436 - "POST /node/69e256bc408ad4de248666a7 HTTP/1.0" 202 Accepted 2026-04-19 15:50:27,807 - lava_callback - INFO - Starting async job submit for node 69e256bc408ad4de248666a7 2026-04-19 15:50:27,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:50:27,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e256bc408ad4de248666a7 HTTP/1.1" 200 None 2026-04-19 15:50:27,824 - lava_callback - DEBUG - Processing node 69e256bc408ad4de248666a7: baseline-arm64-clabbe 2026-04-19 15:50:27,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e256bc408ad4de248666a7 2026-04-19 15:50:27,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:50:27,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e256bc408ad4de248666a7 HTTP/1.1" 200 None 2026-04-19 15:50:27,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:50:27,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:50:27,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:50:27,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e256bc408ad4de248666a7 HTTP/1.1" 200 None 2026-04-19 15:50:27,889 - lava_callback - ERROR - Error processing callback for node 69e256bc408ad4de248666a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:51:47,854 - lava_callback - INFO - Received callback for node 69e2570a408ad4de248666ce INFO: 172.21.0.1:57390 - "POST /node/69e2570a408ad4de248666ce HTTP/1.0" 202 Accepted 2026-04-19 15:51:47,860 - lava_callback - INFO - Starting async job submit for node 69e2570a408ad4de248666ce 2026-04-19 15:51:47,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:51:47,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2570a408ad4de248666ce HTTP/1.1" 200 None 2026-04-19 15:51:47,875 - lava_callback - DEBUG - Processing node 69e2570a408ad4de248666ce: baseline-arm64-clabbe 2026-04-19 15:51:47,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e2570a408ad4de248666ce 2026-04-19 15:51:47,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:51:47,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e2570a408ad4de248666ce HTTP/1.1" 200 None 2026-04-19 15:51:47,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:51:47,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:51:47,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:51:47,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e2570a408ad4de248666ce HTTP/1.1" 200 None 2026-04-19 15:51:47,931 - lava_callback - ERROR - Error processing callback for node 69e2570a408ad4de248666ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:53:07,912 - lava_callback - INFO - Received callback for node 69e25758408ad4de248666ea INFO: 172.21.0.1:44450 - "POST /node/69e25758408ad4de248666ea HTTP/1.0" 202 Accepted 2026-04-19 15:53:07,918 - lava_callback - INFO - Starting async job submit for node 69e25758408ad4de248666ea 2026-04-19 15:53:07,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:53:07,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25758408ad4de248666ea HTTP/1.1" 200 None 2026-04-19 15:53:07,945 - lava_callback - DEBUG - Processing node 69e25758408ad4de248666ea: baseline-arm64-clabbe 2026-04-19 15:53:07,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e25758408ad4de248666ea 2026-04-19 15:53:07,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:53:07,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25758408ad4de248666ea HTTP/1.1" 200 None 2026-04-19 15:53:07,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:53:07,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:53:07,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:53:07,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e25758408ad4de248666ea HTTP/1.1" 200 None 2026-04-19 15:53:07,993 - lava_callback - ERROR - Error processing callback for node 69e25758408ad4de248666ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:54:27,969 - lava_callback - INFO - Received callback for node 69e257a7408ad4de2486670d INFO: 172.21.0.1:40852 - "POST /node/69e257a7408ad4de2486670d HTTP/1.0" 202 Accepted 2026-04-19 15:54:27,978 - lava_callback - INFO - Starting async job submit for node 69e257a7408ad4de2486670d 2026-04-19 15:54:27,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:54:27,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e257a7408ad4de2486670d HTTP/1.1" 200 None 2026-04-19 15:54:27,997 - lava_callback - DEBUG - Processing node 69e257a7408ad4de2486670d: baseline-arm64-clabbe 2026-04-19 15:54:27,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e257a7408ad4de2486670d 2026-04-19 15:54:27,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:54:28,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e257a7408ad4de2486670d HTTP/1.1" 200 None 2026-04-19 15:54:28,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:54:28,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e1ec6b408ad4de24863c48 HTTP/1.1" 200 None 2026-04-19 15:54:28,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:54:28,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e257a7408ad4de2486670d HTTP/1.1" 200 None 2026-04-19 15:54:28,060 - lava_callback - ERROR - Error processing callback for node 69e257a7408ad4de2486670d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:55:48,028 - lava_callback - INFO - Received callback for node 69e257f5408ad4de24866728 INFO: 172.21.0.1:45928 - "POST /node/69e257f5408ad4de24866728 HTTP/1.0" 202 Accepted 2026-04-19 15:55:48,035 - lava_callback - INFO - Starting async job submit for node 69e257f5408ad4de24866728 2026-04-19 15:55:48,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:55:48,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e257f5408ad4de24866728 HTTP/1.1" 200 None 2026-04-19 15:55:48,051 - lava_callback - DEBUG - Processing node 69e257f5408ad4de24866728: baseline-arm64-clabbe 2026-04-19 15:55:48,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e257f5408ad4de24866728 2026-04-19 15:55:48,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:55:48,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e257f5408ad4de24866728 HTTP/1.1" 200 None 2026-04-19 15:55:48,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:55:48,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:55:48,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:55:48,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e257f5408ad4de24866728 HTTP/1.1" 200 None 2026-04-19 15:55:48,109 - lava_callback - ERROR - Error processing callback for node 69e257f5408ad4de24866728: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:38236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:57:08,064 - lava_callback - INFO - Received callback for node 69e25844408ad4de24866749 INFO: 172.21.0.1:48242 - "POST /node/69e25844408ad4de24866749 HTTP/1.0" 202 Accepted 2026-04-19 15:57:08,070 - lava_callback - INFO - Starting async job submit for node 69e25844408ad4de24866749 2026-04-19 15:57:08,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:57:08,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25844408ad4de24866749 HTTP/1.1" 200 None 2026-04-19 15:57:08,088 - lava_callback - DEBUG - Processing node 69e25844408ad4de24866749: baseline-arm64-clabbe 2026-04-19 15:57:08,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e25844408ad4de24866749 2026-04-19 15:57:08,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:57:08,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25844408ad4de24866749 HTTP/1.1" 200 None 2026-04-19 15:57:08,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:57:08,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:57:08,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:57:08,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e25844408ad4de24866749 HTTP/1.1" 200 None 2026-04-19 15:57:08,140 - lava_callback - ERROR - Error processing callback for node 69e25844408ad4de24866749: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:58:28,149 - lava_callback - INFO - Received callback for node 69e25893408ad4de2486676e INFO: 172.21.0.1:44890 - "POST /node/69e25893408ad4de2486676e HTTP/1.0" 202 Accepted 2026-04-19 15:58:28,154 - lava_callback - INFO - Starting async job submit for node 69e25893408ad4de2486676e 2026-04-19 15:58:28,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:58:28,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25893408ad4de2486676e HTTP/1.1" 200 None 2026-04-19 15:58:28,171 - lava_callback - DEBUG - Processing node 69e25893408ad4de2486676e: baseline-arm64-clabbe 2026-04-19 15:58:28,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e25893408ad4de2486676e 2026-04-19 15:58:28,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:58:28,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25893408ad4de2486676e HTTP/1.1" 200 None 2026-04-19 15:58:28,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:58:28,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:58:28,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:58:28,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e25893408ad4de2486676e HTTP/1.1" 200 None 2026-04-19 15:58:28,219 - lava_callback - ERROR - Error processing callback for node 69e25893408ad4de2486676e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK 2026-04-19 15:59:48,243 - lava_callback - INFO - Received callback for node 69e258e3408ad4de24866785 INFO: 172.21.0.1:34546 - "POST /node/69e258e3408ad4de24866785 HTTP/1.0" 202 Accepted 2026-04-19 15:59:48,248 - lava_callback - INFO - Starting async job submit for node 69e258e3408ad4de24866785 2026-04-19 15:59:48,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:59:48,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e258e3408ad4de24866785 HTTP/1.1" 200 None 2026-04-19 15:59:48,271 - lava_callback - DEBUG - Processing node 69e258e3408ad4de24866785: baseline-arm64-clabbe 2026-04-19 15:59:48,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e258e3408ad4de24866785 2026-04-19 15:59:48,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:59:48,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e258e3408ad4de24866785 HTTP/1.1" 200 None 2026-04-19 15:59:48,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:59:48,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 15:59:48,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 15:59:48,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e258e3408ad4de24866785 HTTP/1.1" 200 None 2026-04-19 15:59:48,323 - lava_callback - ERROR - Error processing callback for node 69e258e3408ad4de24866785: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK 2026-04-19 16:01:08,204 - lava_callback - INFO - Received callback for node 69e25937408ad4de248667a6 INFO: 172.21.0.1:59586 - "POST /node/69e25937408ad4de248667a6 HTTP/1.0" 202 Accepted 2026-04-19 16:01:08,210 - lava_callback - INFO - Starting async job submit for node 69e25937408ad4de248667a6 2026-04-19 16:01:08,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:01:08,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25937408ad4de248667a6 HTTP/1.1" 200 None 2026-04-19 16:01:08,226 - lava_callback - DEBUG - Processing node 69e25937408ad4de248667a6: baseline-arm64-clabbe 2026-04-19 16:01:08,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e25937408ad4de248667a6 2026-04-19 16:01:08,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:01:08,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25937408ad4de248667a6 HTTP/1.1" 200 None 2026-04-19 16:01:08,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:01:08,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 16:01:08,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:01:08,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e25937408ad4de248667a6 HTTP/1.1" 200 None 2026-04-19 16:01:08,279 - lava_callback - ERROR - Error processing callback for node 69e25937408ad4de248667a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK 2026-04-19 16:02:28,266 - lava_callback - INFO - Received callback for node 69e25988408ad4de248667c8 INFO: 172.21.0.1:38104 - "POST /node/69e25988408ad4de248667c8 HTTP/1.0" 202 Accepted 2026-04-19 16:02:28,274 - lava_callback - INFO - Starting async job submit for node 69e25988408ad4de248667c8 2026-04-19 16:02:28,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:02:28,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25988408ad4de248667c8 HTTP/1.1" 200 None 2026-04-19 16:02:28,289 - lava_callback - DEBUG - Processing node 69e25988408ad4de248667c8: baseline-arm64-clabbe 2026-04-19 16:02:28,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e25988408ad4de248667c8 2026-04-19 16:02:28,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:02:28,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25988408ad4de248667c8 HTTP/1.1" 200 None 2026-04-19 16:02:28,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:02:28,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 16:02:28,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:02:28,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e25988408ad4de248667c8 HTTP/1.1" 200 None 2026-04-19 16:02:28,342 - lava_callback - ERROR - Error processing callback for node 69e25988408ad4de248667c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK 2026-04-19 16:03:48,306 - lava_callback - INFO - Received callback for node 69e259d7408ad4de248667e5 INFO: 172.21.0.1:41966 - "POST /node/69e259d7408ad4de248667e5 HTTP/1.0" 202 Accepted 2026-04-19 16:03:48,311 - lava_callback - INFO - Starting async job submit for node 69e259d7408ad4de248667e5 2026-04-19 16:03:48,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:03:48,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e259d7408ad4de248667e5 HTTP/1.1" 200 None 2026-04-19 16:03:48,334 - lava_callback - DEBUG - Processing node 69e259d7408ad4de248667e5: baseline-arm64-clabbe 2026-04-19 16:03:48,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e259d7408ad4de248667e5 2026-04-19 16:03:48,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:03:48,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e259d7408ad4de248667e5 HTTP/1.1" 200 None 2026-04-19 16:03:48,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:03:48,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-19 16:03:48,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-19 16:03:48,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e259d7408ad4de248667e5 HTTP/1.1" 200 None 2026-04-19 16:03:48,409 - lava_callback - ERROR - Error processing callback for node 69e259d7408ad4de248667e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]