INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:32:51,058 - lava_callback - INFO - Received callback for node 69a8ceb9911a9cbe7f77cddf 2026-03-05 00:32:51,071 - lava_callback - INFO - Starting async job submit for node 69a8ceb9911a9cbe7f77cddf INFO: 172.21.0.1:42930 - "POST /node/69a8ceb9911a9cbe7f77cddf HTTP/1.0" 202 Accepted 2026-03-05 00:32:51,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:32:51,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ceb9911a9cbe7f77cddf HTTP/1.1" 200 None 2026-03-05 00:32:51,140 - lava_callback - DEBUG - Processing node 69a8ceb9911a9cbe7f77cddf: baseline-arm 2026-03-05 00:32:51,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:32:51,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:32:51,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8ceb9911a9cbe7f77cddf/log.txt.gz 2026-03-05 00:32:51,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:32:51,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:32:51,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8ceb9911a9cbe7f77cddf/lava-logs.yaml 2026-03-05 00:32:51,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:32:52,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:32:52,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8ceb9911a9cbe7f77cddf/lava_callback.json.gz 2026-03-05 00:32:52,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:32:52,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ceb9911a9cbe7f77cddf HTTP/1.1" 200 None 2026-03-05 00:32:52,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:32:52,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbc3911a9cbe7f77ccb1 HTTP/1.1" 200 None 2026-03-05 00:32:52,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:32:52,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ceb9911a9cbe7f77cddf HTTP/1.1" 200 None 2026-03-05 00:32:52,135 - lava_callback - INFO - Completed processing callback for node 69a8ceb9911a9cbe7f77cddf INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:33:22,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:33:22,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:36:48,684 - lava_callback - INFO - Received callback for node 69a62d0c7da105ad098359f2 INFO: 172.21.0.1:41224 - "POST /node/69a62d0c7da105ad098359f2 HTTP/1.0" 202 Accepted 2026-03-05 00:36:48,690 - lava_callback - INFO - Starting async job submit for node 69a62d0c7da105ad098359f2 2026-03-05 00:36:48,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:48,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d0c7da105ad098359f2 HTTP/1.1" 200 None 2026-03-05 00:36:48,707 - lava_callback - DEBUG - Processing node 69a62d0c7da105ad098359f2: baseline-x86 2026-03-05 00:36:48,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a62d0c7da105ad098359f2 2026-03-05 00:36:48,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:48,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d0c7da105ad098359f2 HTTP/1.1" 200 None 2026-03-05 00:36:48,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:48,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628c07da105ad098359bf HTTP/1.1" 200 None 2026-03-05 00:36:48,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:48,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a62d0c7da105ad098359f2 HTTP/1.1" 200 None 2026-03-05 00:36:48,793 - lava_callback - ERROR - Error processing callback for node 69a62d0c7da105ad098359f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 00:36:56,212 - lava_callback - INFO - Received callback for node 69a62d177da105ad09835a1f INFO: 172.21.0.1:58188 - "POST /node/69a62d177da105ad09835a1f HTTP/1.0" 202 Accepted 2026-03-05 00:36:56,222 - lava_callback - INFO - Starting async job submit for node 69a62d177da105ad09835a1f 2026-03-05 00:36:56,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:56,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d177da105ad09835a1f HTTP/1.1" 200 None 2026-03-05 00:36:56,267 - lava_callback - DEBUG - Processing node 69a62d177da105ad09835a1f: baseline-arm-baylibre 2026-03-05 00:36:56,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a62d177da105ad09835a1f 2026-03-05 00:36:56,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:56,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d177da105ad09835a1f HTTP/1.1" 200 None 2026-03-05 00:36:56,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:56,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 00:36:56,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:56,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a62d177da105ad09835a1f HTTP/1.1" 200 None 2026-03-05 00:36:56,388 - lava_callback - ERROR - Error processing callback for node 69a62d177da105ad09835a1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:36:56,872 - lava_callback - INFO - Received callback for node 69a62d187da105ad09835a22 INFO: 172.21.0.1:58196 - "POST /node/69a62d187da105ad09835a22 HTTP/1.0" 202 Accepted 2026-03-05 00:36:56,878 - lava_callback - INFO - Starting async job submit for node 69a62d187da105ad09835a22 2026-03-05 00:36:56,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:56,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d187da105ad09835a22 HTTP/1.1" 200 None 2026-03-05 00:36:56,895 - lava_callback - DEBUG - Processing node 69a62d187da105ad09835a22: baseline-arm-baylibre 2026-03-05 00:36:56,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a62d187da105ad09835a22 2026-03-05 00:36:56,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:56,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d187da105ad09835a22 HTTP/1.1" 200 None 2026-03-05 00:36:56,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:56,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 00:36:56,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:56,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a62d187da105ad09835a22 HTTP/1.1" 200 None 2026-03-05 00:36:56,955 - lava_callback - ERROR - Error processing callback for node 69a62d187da105ad09835a22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 00:36:57,539 - lava_callback - INFO - Received callback for node 69a62d1a7da105ad09835a25 INFO: 172.21.0.1:58200 - "POST /node/69a62d1a7da105ad09835a25 HTTP/1.0" 202 Accepted 2026-03-05 00:36:57,548 - lava_callback - INFO - Starting async job submit for node 69a62d1a7da105ad09835a25 2026-03-05 00:36:57,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:57,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d1a7da105ad09835a25 HTTP/1.1" 200 None 2026-03-05 00:36:57,564 - lava_callback - DEBUG - Processing node 69a62d1a7da105ad09835a25: baseline-arm-baylibre 2026-03-05 00:36:57,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a62d1a7da105ad09835a25 2026-03-05 00:36:57,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:57,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d1a7da105ad09835a25 HTTP/1.1" 200 None 2026-03-05 00:36:57,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:57,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 00:36:57,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:57,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a62d1a7da105ad09835a25 HTTP/1.1" 200 None 2026-03-05 00:36:57,625 - lava_callback - ERROR - Error processing callback for node 69a62d1a7da105ad09835a25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 00:36:58,209 - lava_callback - INFO - Received callback for node 69a62d1b7da105ad09835a28 INFO: 172.21.0.1:58204 - "POST /node/69a62d1b7da105ad09835a28 HTTP/1.0" 202 Accepted 2026-03-05 00:36:58,214 - lava_callback - INFO - Starting async job submit for node 69a62d1b7da105ad09835a28 2026-03-05 00:36:58,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:58,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d1b7da105ad09835a28 HTTP/1.1" 200 None 2026-03-05 00:36:58,230 - lava_callback - DEBUG - Processing node 69a62d1b7da105ad09835a28: baseline-arm-baylibre 2026-03-05 00:36:58,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a62d1b7da105ad09835a28 2026-03-05 00:36:58,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:58,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d1b7da105ad09835a28 HTTP/1.1" 200 None 2026-03-05 00:36:58,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:58,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 00:36:58,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:58,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a62d1b7da105ad09835a28 HTTP/1.1" 200 None 2026-03-05 00:36:58,299 - lava_callback - ERROR - Error processing callback for node 69a62d1b7da105ad09835a28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 00:36:58,877 - lava_callback - INFO - Received callback for node 69a62d1e7da105ad09835a33 INFO: 172.21.0.1:58216 - "POST /node/69a62d1e7da105ad09835a33 HTTP/1.0" 202 Accepted 2026-03-05 00:36:58,883 - lava_callback - INFO - Starting async job submit for node 69a62d1e7da105ad09835a33 2026-03-05 00:36:58,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:58,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d1e7da105ad09835a33 HTTP/1.1" 200 None 2026-03-05 00:36:58,899 - lava_callback - DEBUG - Processing node 69a62d1e7da105ad09835a33: baseline-arm-baylibre 2026-03-05 00:36:58,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a62d1e7da105ad09835a33 2026-03-05 00:36:58,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:58,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d1e7da105ad09835a33 HTTP/1.1" 200 None 2026-03-05 00:36:58,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:58,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 00:36:58,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:58,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a62d1e7da105ad09835a33 HTTP/1.1" 200 None 2026-03-05 00:36:58,962 - lava_callback - ERROR - Error processing callback for node 69a62d1e7da105ad09835a33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 00:36:59,549 - lava_callback - INFO - Received callback for node 69a62d1f7da105ad09835a37 INFO: 172.21.0.1:58218 - "POST /node/69a62d1f7da105ad09835a37 HTTP/1.0" 202 Accepted 2026-03-05 00:36:59,554 - lava_callback - INFO - Starting async job submit for node 69a62d1f7da105ad09835a37 2026-03-05 00:36:59,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:59,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d1f7da105ad09835a37 HTTP/1.1" 200 None 2026-03-05 00:36:59,570 - lava_callback - DEBUG - Processing node 69a62d1f7da105ad09835a37: baseline-arm-baylibre 2026-03-05 00:36:59,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a62d1f7da105ad09835a37 2026-03-05 00:36:59,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:59,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a62d1f7da105ad09835a37 HTTP/1.1" 200 None 2026-03-05 00:36:59,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:59,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 00:36:59,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:36:59,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a62d1f7da105ad09835a37 HTTP/1.1" 200 None 2026-03-05 00:36:59,624 - lava_callback - ERROR - Error processing callback for node 69a62d1f7da105ad09835a37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:49:36,943 - lava_callback - INFO - Received callback for node 69a6300d7da105ad09835fcf INFO: 172.21.0.1:43404 - "POST /node/69a6300d7da105ad09835fcf HTTP/1.0" 202 Accepted 2026-03-05 00:49:36,949 - lava_callback - INFO - Starting async job submit for node 69a6300d7da105ad09835fcf 2026-03-05 00:49:36,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:49:36,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6300d7da105ad09835fcf HTTP/1.1" 200 None 2026-03-05 00:49:36,966 - lava_callback - DEBUG - Processing node 69a6300d7da105ad09835fcf: baseline-arm-baylibre 2026-03-05 00:49:36,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6300d7da105ad09835fcf 2026-03-05 00:49:36,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:49:36,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6300d7da105ad09835fcf HTTP/1.1" 200 None 2026-03-05 00:49:36,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:49:36,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 00:49:37,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:49:37,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6300d7da105ad09835fcf HTTP/1.1" 200 None 2026-03-05 00:49:37,052 - lava_callback - ERROR - Error processing callback for node 69a6300d7da105ad09835fcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:50:16,803 - lava_callback - INFO - Received callback for node 69a6303d7da105ad0983600f INFO: 172.21.0.1:47530 - "POST /node/69a6303d7da105ad0983600f HTTP/1.0" 202 Accepted 2026-03-05 00:50:16,808 - lava_callback - INFO - Starting async job submit for node 69a6303d7da105ad0983600f 2026-03-05 00:50:16,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:16,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6303d7da105ad0983600f HTTP/1.1" 200 None 2026-03-05 00:50:16,824 - lava_callback - DEBUG - Processing node 69a6303d7da105ad0983600f: baseline-arm-baylibre 2026-03-05 00:50:16,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6303d7da105ad0983600f 2026-03-05 00:50:16,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:16,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6303d7da105ad0983600f HTTP/1.1" 200 None 2026-03-05 00:50:16,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:16,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 00:50:16,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:16,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6303d7da105ad0983600f HTTP/1.1" 200 None 2026-03-05 00:50:16,881 - lava_callback - ERROR - Error processing callback for node 69a6303d7da105ad0983600f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36234 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:50:49,225 - lava_callback - INFO - Received callback for node 69a8ceba911a9cbe7f77cde2 INFO: 172.21.0.1:36236 - "POST /node/69a8ceba911a9cbe7f77cde2 HTTP/1.0" 202 Accepted 2026-03-05 00:50:49,233 - lava_callback - INFO - Starting async job submit for node 69a8ceba911a9cbe7f77cde2 2026-03-05 00:50:49,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:49,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ceba911a9cbe7f77cde2 HTTP/1.1" 200 None 2026-03-05 00:50:49,307 - lava_callback - DEBUG - Processing node 69a8ceba911a9cbe7f77cde2: ltp-smoke 2026-03-05 00:50:49,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:50:49,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:50:49,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8ceba911a9cbe7f77cde2/log.txt.gz 2026-03-05 00:50:50,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:50:50,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:50:50,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8ceba911a9cbe7f77cde2/lava-logs.yaml 2026-03-05 00:50:50,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:50:50,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:50:50,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8ceba911a9cbe7f77cde2/lava_callback.json.gz 2026-03-05 00:50:50,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:50,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ceba911a9cbe7f77cde2 HTTP/1.1" 200 None 2026-03-05 00:50:50,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:50,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbc3911a9cbe7f77ccb1 HTTP/1.1" 200 None 2026-03-05 00:50:50,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:50,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ceba911a9cbe7f77cde2 HTTP/1.1" 200 None 2026-03-05 00:50:51,057 - lava_callback - INFO - Completed processing callback for node 69a8ceba911a9cbe7f77cde2 2026-03-05 00:50:52,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:50:52,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:52:57,040 - lava_callback - INFO - Received callback for node 69a630dc7da105ad09836053 INFO: 172.21.0.1:43858 - "POST /node/69a630dc7da105ad09836053 HTTP/1.0" 202 Accepted 2026-03-05 00:52:57,046 - lava_callback - INFO - Starting async job submit for node 69a630dc7da105ad09836053 2026-03-05 00:52:57,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:52:57,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a630dc7da105ad09836053 HTTP/1.1" 200 None 2026-03-05 00:52:57,074 - lava_callback - DEBUG - Processing node 69a630dc7da105ad09836053: baseline-arm-baylibre 2026-03-05 00:52:57,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a630dc7da105ad09836053 2026-03-05 00:52:57,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:52:57,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a630dc7da105ad09836053 HTTP/1.1" 200 None 2026-03-05 00:52:57,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:52:57,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 00:52:57,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:52:57,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a630dc7da105ad09836053 HTTP/1.1" 200 None 2026-03-05 00:52:57,181 - lava_callback - ERROR - Error processing callback for node 69a630dc7da105ad09836053: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43296 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:53:36,962 - lava_callback - INFO - Received callback for node 69a6310e7da105ad09836067 INFO: 172.21.0.1:43304 - "POST /node/69a6310e7da105ad09836067 HTTP/1.0" 202 Accepted 2026-03-05 00:53:36,972 - lava_callback - INFO - Starting async job submit for node 69a6310e7da105ad09836067 2026-03-05 00:53:36,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:53:37,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6310e7da105ad09836067 HTTP/1.1" 200 None 2026-03-05 00:53:37,050 - lava_callback - DEBUG - Processing node 69a6310e7da105ad09836067: baseline-arm-baylibre 2026-03-05 00:53:37,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6310e7da105ad09836067 2026-03-05 00:53:37,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:53:37,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6310e7da105ad09836067 HTTP/1.1" 200 None 2026-03-05 00:53:37,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:53:37,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 00:53:37,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:53:37,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6310e7da105ad09836067 HTTP/1.1" 200 None 2026-03-05 00:53:37,148 - lava_callback - ERROR - Error processing callback for node 69a6310e7da105ad09836067: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:54:11,895 - lava_callback - INFO - Received callback for node 69a8d40f911a9cbe7f77d4c2 INFO: 172.21.0.1:36306 - "POST /node/69a8d40f911a9cbe7f77d4c2 HTTP/1.0" 202 Accepted 2026-03-05 00:54:11,901 - lava_callback - INFO - Starting async job submit for node 69a8d40f911a9cbe7f77d4c2 2026-03-05 00:54:11,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:11,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d40f911a9cbe7f77d4c2 HTTP/1.1" 200 None 2026-03-05 00:54:11,935 - lava_callback - DEBUG - Processing node 69a8d40f911a9cbe7f77d4c2: baseline-x86 2026-03-05 00:54:12,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:54:12,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:54:12,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d40f911a9cbe7f77d4c2/log.txt.gz 2026-03-05 00:54:12,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:54:12,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:54:12,611 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d40f911a9cbe7f77d4c2/lava-logs.yaml 2026-03-05 00:54:12,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:54:12,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:54:12,772 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d40f911a9cbe7f77d4c2/lava_callback.json.gz 2026-03-05 00:54:12,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:12,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d40f911a9cbe7f77d4c2 HTTP/1.1" 200 None 2026-03-05 00:54:12,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:12,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbea911a9cbe7f77cce8 HTTP/1.1" 200 None 2026-03-05 00:54:12,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:12,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d40f911a9cbe7f77d4c2 HTTP/1.1" 200 None 2026-03-05 00:54:12,864 - lava_callback - INFO - Completed processing callback for node 69a8d40f911a9cbe7f77d4c2 INFO: 172.21.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-05 00:54:15,661 - lava_callback - INFO - Received callback for node 69a8d411911a9cbe7f77d4cd INFO: 172.21.0.1:36330 - "POST /node/69a8d411911a9cbe7f77d4cd HTTP/1.0" 202 Accepted 2026-03-05 00:54:15,668 - lava_callback - INFO - Starting async job submit for node 69a8d411911a9cbe7f77d4cd 2026-03-05 00:54:15,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:15,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d411911a9cbe7f77d4cd HTTP/1.1" 200 None 2026-03-05 00:54:15,700 - lava_callback - DEBUG - Processing node 69a8d411911a9cbe7f77d4cd: baseline-x86 2026-03-05 00:54:15,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:54:15,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:54:15,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d411911a9cbe7f77d4cd/log.txt.gz 2026-03-05 00:54:16,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:54:16,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:54:16,286 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d411911a9cbe7f77d4cd/lava-logs.yaml 2026-03-05 00:54:16,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:54:16,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:54:16,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d411911a9cbe7f77d4cd/lava_callback.json.gz 2026-03-05 00:54:16,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:16,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d411911a9cbe7f77d4cd HTTP/1.1" 200 None 2026-03-05 00:54:16,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:16,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbea911a9cbe7f77cce8 HTTP/1.1" 200 None 2026-03-05 00:54:16,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:54:16,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d411911a9cbe7f77d4cd HTTP/1.1" 200 None 2026-03-05 00:54:16,536 - lava_callback - INFO - Completed processing callback for node 69a8d411911a9cbe7f77d4cd 2026-03-05 00:54:22,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:22,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:54:37,106 - lava_callback - INFO - Received callback for node 69a6313f7da105ad09836079 INFO: 172.21.0.1:32890 - "POST /node/69a6313f7da105ad09836079 HTTP/1.0" 202 Accepted 2026-03-05 00:54:37,112 - lava_callback - INFO - Starting async job submit for node 69a6313f7da105ad09836079 2026-03-05 00:54:37,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:37,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6313f7da105ad09836079 HTTP/1.1" 200 None 2026-03-05 00:54:37,127 - lava_callback - DEBUG - Processing node 69a6313f7da105ad09836079: baseline-arm-baylibre 2026-03-05 00:54:37,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6313f7da105ad09836079 2026-03-05 00:54:37,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:37,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6313f7da105ad09836079 HTTP/1.1" 200 None 2026-03-05 00:54:37,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:37,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 00:54:37,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:54:37,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6313f7da105ad09836079 HTTP/1.1" 200 None 2026-03-05 00:54:37,184 - lava_callback - ERROR - Error processing callback for node 69a6313f7da105ad09836079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:55:07,649 - lava_callback - INFO - Received callback for node 69a8d410911a9cbe7f77d4c8 INFO: 172.21.0.1:41554 - "POST /node/69a8d410911a9cbe7f77d4c8 HTTP/1.0" 202 Accepted 2026-03-05 00:55:07,658 - lava_callback - INFO - Starting async job submit for node 69a8d410911a9cbe7f77d4c8 2026-03-05 00:55:07,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:07,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d410911a9cbe7f77d4c8 HTTP/1.1" 200 None 2026-03-05 00:55:07,703 - lava_callback - DEBUG - Processing node 69a8d410911a9cbe7f77d4c8: baseline-x86 2026-03-05 00:55:08,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:55:08,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:55:08,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d410911a9cbe7f77d4c8/log.txt.gz 2026-03-05 00:55:08,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:55:08,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:55:08,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d410911a9cbe7f77d4c8/lava-logs.yaml 2026-03-05 00:55:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:55:09,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:55:09,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d410911a9cbe7f77d4c8/lava_callback.json.gz 2026-03-05 00:55:09,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:09,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d410911a9cbe7f77d4c8 HTTP/1.1" 200 None 2026-03-05 00:55:09,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:09,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbea911a9cbe7f77cce8 HTTP/1.1" 200 None 2026-03-05 00:55:09,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:09,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d410911a9cbe7f77d4c8 HTTP/1.1" 200 None 2026-03-05 00:55:09,174 - lava_callback - INFO - Completed processing callback for node 69a8d410911a9cbe7f77d4c8 INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:55:14,571 - lava_callback - INFO - Received callback for node 69a8d410911a9cbe7f77d4c5 INFO: 172.21.0.1:58920 - "POST /node/69a8d410911a9cbe7f77d4c5 HTTP/1.0" 202 Accepted 2026-03-05 00:55:14,581 - lava_callback - INFO - Starting async job submit for node 69a8d410911a9cbe7f77d4c5 2026-03-05 00:55:14,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:14,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d410911a9cbe7f77d4c5 HTTP/1.1" 200 None 2026-03-05 00:55:14,628 - lava_callback - DEBUG - Processing node 69a8d410911a9cbe7f77d4c5: baseline-x86 2026-03-05 00:55:14,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:55:15,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:55:15,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d410911a9cbe7f77d4c5/log.txt.gz INFO: 172.21.0.1:58926 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-05 00:55:15,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:55:15,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:55:15,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d410911a9cbe7f77d4c5/lava-logs.yaml 2026-03-05 00:55:15,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 00:55:15,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 00:55:15,956 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69a8d410911a9cbe7f77d4c5/lava_callback.json.gz 2026-03-05 00:55:15,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:16,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d410911a9cbe7f77d4c5 HTTP/1.1" 200 None 2026-03-05 00:55:16,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:16,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbea911a9cbe7f77cce8 HTTP/1.1" 200 None 2026-03-05 00:55:16,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:16,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d410911a9cbe7f77d4c5 HTTP/1.1" 200 None 2026-03-05 00:55:16,064 - lava_callback - INFO - Completed processing callback for node 69a8d410911a9cbe7f77d4c5 INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:55:17,104 - lava_callback - INFO - Received callback for node 69a631717da105ad09836084 INFO: 172.21.0.1:58956 - "POST /node/69a631717da105ad09836084 HTTP/1.0" 202 Accepted 2026-03-05 00:55:17,110 - lava_callback - INFO - Starting async job submit for node 69a631717da105ad09836084 2026-03-05 00:55:17,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:17,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a631717da105ad09836084 HTTP/1.1" 200 None 2026-03-05 00:55:17,127 - lava_callback - DEBUG - Processing node 69a631717da105ad09836084: baseline-arm-baylibre 2026-03-05 00:55:17,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a631717da105ad09836084 2026-03-05 00:55:17,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:17,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a631717da105ad09836084 HTTP/1.1" 200 None 2026-03-05 00:55:17,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:17,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 00:55:17,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:17,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a631717da105ad09836084 HTTP/1.1" 200 None 2026-03-05 00:55:17,196 - lava_callback - ERROR - Error processing callback for node 69a631717da105ad09836084: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 00:55:22,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:55:22,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:56:57,178 - lava_callback - INFO - Received callback for node 69a631ce7da105ad09836096 INFO: 172.21.0.1:37686 - "POST /node/69a631ce7da105ad09836096 HTTP/1.0" 202 Accepted 2026-03-05 00:56:57,187 - lava_callback - INFO - Starting async job submit for node 69a631ce7da105ad09836096 2026-03-05 00:56:57,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:56:57,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a631ce7da105ad09836096 HTTP/1.1" 200 None 2026-03-05 00:56:57,222 - lava_callback - DEBUG - Processing node 69a631ce7da105ad09836096: baseline-arm-baylibre 2026-03-05 00:56:57,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a631ce7da105ad09836096 2026-03-05 00:56:57,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:56:57,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a631ce7da105ad09836096 HTTP/1.1" 200 None 2026-03-05 00:56:57,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:56:57,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 00:56:57,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:56:57,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a631ce7da105ad09836096 HTTP/1.1" 200 None 2026-03-05 00:56:57,316 - lava_callback - ERROR - Error processing callback for node 69a631ce7da105ad09836096: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:57:37,205 - lava_callback - INFO - Received callback for node 69a631fe7da105ad098360a1 INFO: 172.21.0.1:60892 - "POST /node/69a631fe7da105ad098360a1 HTTP/1.0" 202 Accepted 2026-03-05 00:57:37,215 - lava_callback - INFO - Starting async job submit for node 69a631fe7da105ad098360a1 2026-03-05 00:57:37,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:57:37,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a631fe7da105ad098360a1 HTTP/1.1" 200 None 2026-03-05 00:57:37,245 - lava_callback - DEBUG - Processing node 69a631fe7da105ad098360a1: baseline-arm-baylibre 2026-03-05 00:57:37,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a631fe7da105ad098360a1 2026-03-05 00:57:37,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:57:37,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a631fe7da105ad098360a1 HTTP/1.1" 200 None 2026-03-05 00:57:37,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:57:37,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 00:57:37,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:57:37,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a631fe7da105ad098360a1 HTTP/1.1" 200 None 2026-03-05 00:57:37,341 - lava_callback - ERROR - Error processing callback for node 69a631fe7da105ad098360a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK 2026-03-05 00:59:17,326 - lava_callback - INFO - Received callback for node 69a6325d7da105ad098360b5 INFO: 172.21.0.1:46368 - "POST /node/69a6325d7da105ad098360b5 HTTP/1.0" 202 Accepted 2026-03-05 00:59:17,336 - lava_callback - INFO - Starting async job submit for node 69a6325d7da105ad098360b5 2026-03-05 00:59:17,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:59:17,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6325d7da105ad098360b5 HTTP/1.1" 200 None 2026-03-05 00:59:17,384 - lava_callback - DEBUG - Processing node 69a6325d7da105ad098360b5: baseline-arm-baylibre 2026-03-05 00:59:17,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6325d7da105ad098360b5 2026-03-05 00:59:17,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:59:17,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6325d7da105ad098360b5 HTTP/1.1" 200 None 2026-03-05 00:59:17,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:59:17,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 00:59:17,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 00:59:17,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6325d7da105ad098360b5 HTTP/1.1" 200 None 2026-03-05 00:59:17,497 - lava_callback - ERROR - Error processing callback for node 69a6325d7da105ad098360b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:00:57,412 - lava_callback - INFO - Received callback for node 69a632bf7da105ad09836104 INFO: 172.21.0.1:41504 - "POST /node/69a632bf7da105ad09836104 HTTP/1.0" 202 Accepted 2026-03-05 01:00:57,422 - lava_callback - INFO - Starting async job submit for node 69a632bf7da105ad09836104 2026-03-05 01:00:57,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:00:57,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a632bf7da105ad09836104 HTTP/1.1" 200 None 2026-03-05 01:00:57,521 - lava_callback - DEBUG - Processing node 69a632bf7da105ad09836104: baseline-arm-baylibre 2026-03-05 01:00:57,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a632bf7da105ad09836104 2026-03-05 01:00:57,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:00:57,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a632bf7da105ad09836104 HTTP/1.1" 200 None 2026-03-05 01:00:57,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:00:57,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 01:00:57,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:00:57,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a632bf7da105ad09836104 HTTP/1.1" 200 None 2026-03-05 01:00:57,679 - lava_callback - ERROR - Error processing callback for node 69a632bf7da105ad09836104: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:01:00,430 - lava_callback - INFO - Received callback for node 69a8d5a6911a9cbe7f77d5ec INFO: 172.21.0.1:34670 - "POST /node/69a8d5a6911a9cbe7f77d5ec HTTP/1.0" 202 Accepted 2026-03-05 01:01:00,441 - lava_callback - INFO - Starting async job submit for node 69a8d5a6911a9cbe7f77d5ec 2026-03-05 01:01:00,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:00,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5a6911a9cbe7f77d5ec HTTP/1.1" 200 None 2026-03-05 01:01:00,504 - lava_callback - DEBUG - Processing node 69a8d5a6911a9cbe7f77d5ec: baseline-arm64 2026-03-05 01:01:00,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:01,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:01,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a6911a9cbe7f77d5ec/log.txt.gz 2026-03-05 01:01:01,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:02,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:02,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a6911a9cbe7f77d5ec/lava-logs.yaml 2026-03-05 01:01:02,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:02,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:02,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a6911a9cbe7f77d5ec/lava_callback.json.gz 2026-03-05 01:01:02,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:02,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5a6911a9cbe7f77d5ec HTTP/1.1" 200 None 2026-03-05 01:01:02,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:02,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:02,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:02,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5a6911a9cbe7f77d5ec HTTP/1.1" 200 None 2026-03-05 01:01:02,676 - lava_callback - INFO - Completed processing callback for node 69a8d5a6911a9cbe7f77d5ec INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-05 01:01:15,248 - lava_callback - INFO - Received callback for node 69a8d5c5911a9cbe7f77d646 INFO: 172.21.0.1:43672 - "POST /node/69a8d5c5911a9cbe7f77d646 HTTP/1.0" 202 Accepted 2026-03-05 01:01:15,264 - lava_callback - INFO - Starting async job submit for node 69a8d5c5911a9cbe7f77d646 2026-03-05 01:01:15,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:15,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c5911a9cbe7f77d646 HTTP/1.1" 200 None 2026-03-05 01:01:15,295 - lava_callback - DEBUG - Processing node 69a8d5c5911a9cbe7f77d646: baseline-nfs-arm64 2026-03-05 01:01:15,297 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:01:15,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:15,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:15,695 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c5911a9cbe7f77d646/lava-logs.yaml 2026-03-05 01:01:15,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:16,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:16,150 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c5911a9cbe7f77d646/lava_callback.json.gz 2026-03-05 01:01:16,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:16,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c5911a9cbe7f77d646 HTTP/1.1" 200 None 2026-03-05 01:01:16,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:16,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:16,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:16,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5c5911a9cbe7f77d646 HTTP/1.1" 200 None 2026-03-05 01:01:16,247 - lava_callback - INFO - Completed processing callback for node 69a8d5c5911a9cbe7f77d646 INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:01:18,761 - lava_callback - INFO - Received callback for node 69a8d5cd911a9cbe7f77d67f INFO: 172.21.0.1:43690 - "POST /node/69a8d5cd911a9cbe7f77d67f HTTP/1.0" 202 Accepted 2026-03-05 01:01:18,775 - lava_callback - INFO - Starting async job submit for node 69a8d5cd911a9cbe7f77d67f 2026-03-05 01:01:18,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:18,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5cd911a9cbe7f77d67f HTTP/1.1" 200 None 2026-03-05 01:01:18,828 - lava_callback - DEBUG - Processing node 69a8d5cd911a9cbe7f77d67f: baseline-nfs-arm64 2026-03-05 01:01:18,830 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:01:18,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:19,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:19,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cd911a9cbe7f77d67f/lava-logs.yaml 2026-03-05 01:01:19,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:19,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:19,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cd911a9cbe7f77d67f/lava_callback.json.gz 2026-03-05 01:01:19,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:19,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5cd911a9cbe7f77d67f HTTP/1.1" 200 None 2026-03-05 01:01:19,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:19,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:19,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5cd911a9cbe7f77d67f HTTP/1.1" 200 None 2026-03-05 01:01:19,775 - lava_callback - INFO - Completed processing callback for node 69a8d5cd911a9cbe7f77d67f 2026-03-05 01:01:21,995 - lava_callback - INFO - Received callback for node 69a8d5b7911a9cbe7f77d62b INFO: 172.21.0.1:49526 - "POST /node/69a8d5b7911a9cbe7f77d62b HTTP/1.0" 202 Accepted 2026-03-05 01:01:22,009 - lava_callback - INFO - Starting async job submit for node 69a8d5b7911a9cbe7f77d62b 2026-03-05 01:01:22,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:22,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b7911a9cbe7f77d62b HTTP/1.1" 200 None 2026-03-05 01:01:22,077 - lava_callback - DEBUG - Processing node 69a8d5b7911a9cbe7f77d62b: baseline-arm64 2026-03-05 01:01:22,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:22,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 01:01:22,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:23,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:23,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b7911a9cbe7f77d62b/log.txt.gz 2026-03-05 01:01:23,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:23,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:23,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b7911a9cbe7f77d62b/lava-logs.yaml 2026-03-05 01:01:23,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:24,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:24,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b7911a9cbe7f77d62b/lava_callback.json.gz 2026-03-05 01:01:24,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:24,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b7911a9cbe7f77d62b HTTP/1.1" 200 None 2026-03-05 01:01:24,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:24,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:24,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:24,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5b7911a9cbe7f77d62b HTTP/1.1" 200 None 2026-03-05 01:01:24,536 - lava_callback - INFO - Completed processing callback for node 69a8d5b7911a9cbe7f77d62b 2026-03-05 01:01:26,035 - lava_callback - INFO - Received callback for node 69a8d5c3911a9cbe7f77d643 INFO: 172.21.0.1:49532 - "POST /node/69a8d5c3911a9cbe7f77d643 HTTP/1.0" 202 Accepted 2026-03-05 01:01:26,048 - lava_callback - INFO - Starting async job submit for node 69a8d5c3911a9cbe7f77d643 2026-03-05 01:01:26,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:26,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c3911a9cbe7f77d643 HTTP/1.1" 200 None 2026-03-05 01:01:26,081 - lava_callback - DEBUG - Processing node 69a8d5c3911a9cbe7f77d643: baseline-nfs-arm64 2026-03-05 01:01:26,083 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:01:26,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:01:26,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:26,588 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c3911a9cbe7f77d643/lava-logs.yaml 2026-03-05 01:01:26,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:26,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:26,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c3911a9cbe7f77d643/lava_callback.json.gz 2026-03-05 01:01:27,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:27,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c3911a9cbe7f77d643 HTTP/1.1" 200 None 2026-03-05 01:01:27,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:27,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:27,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:27,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5c3911a9cbe7f77d643 HTTP/1.1" 200 None 2026-03-05 01:01:27,102 - lava_callback - INFO - Completed processing callback for node 69a8d5c3911a9cbe7f77d643 INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:01:41,159 - lava_callback - INFO - Received callback for node 69a8d5d7911a9cbe7f77d696 INFO: 172.21.0.1:53202 - "POST /node/69a8d5d7911a9cbe7f77d696 HTTP/1.0" 202 Accepted 2026-03-05 01:01:41,171 - lava_callback - INFO - Starting async job submit for node 69a8d5d7911a9cbe7f77d696 2026-03-05 01:01:41,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:41,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d7911a9cbe7f77d696 HTTP/1.1" 200 None 2026-03-05 01:01:41,215 - lava_callback - DEBUG - Processing node 69a8d5d7911a9cbe7f77d696: baseline-nfs-arm64 2026-03-05 01:01:41,217 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:01:41,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:41,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:41,353 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d7911a9cbe7f77d696/lava-logs.yaml 2026-03-05 01:01:41,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:41,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:41,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d7911a9cbe7f77d696/lava_callback.json.gz 2026-03-05 01:01:41,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:41,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d7911a9cbe7f77d696 HTTP/1.1" 200 None 2026-03-05 01:01:41,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:41,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:41,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:41,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5d7911a9cbe7f77d696 HTTP/1.1" 200 None 2026-03-05 01:01:41,638 - lava_callback - INFO - Completed processing callback for node 69a8d5d7911a9cbe7f77d696 INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:01:47,742 - lava_callback - INFO - Received callback for node 69a8d5bc911a9cbe7f77d634 INFO: 172.21.0.1:53212 - "POST /node/69a8d5bc911a9cbe7f77d634 HTTP/1.0" 202 Accepted 2026-03-05 01:01:47,749 - lava_callback - INFO - Starting async job submit for node 69a8d5bc911a9cbe7f77d634 2026-03-05 01:01:47,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:47,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5bc911a9cbe7f77d634 HTTP/1.1" 200 None 2026-03-05 01:01:47,787 - lava_callback - DEBUG - Processing node 69a8d5bc911a9cbe7f77d634: baseline-arm64 2026-03-05 01:01:48,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:48,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:48,178 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bc911a9cbe7f77d634/log.txt.gz 2026-03-05 01:01:48,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:48,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:48,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bc911a9cbe7f77d634/lava-logs.yaml 2026-03-05 01:01:48,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:48,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:48,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bc911a9cbe7f77d634/lava_callback.json.gz 2026-03-05 01:01:48,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:48,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5bc911a9cbe7f77d634 HTTP/1.1" 200 None 2026-03-05 01:01:48,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:48,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:48,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:48,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5bc911a9cbe7f77d634 HTTP/1.1" 200 None 2026-03-05 01:01:48,864 - lava_callback - INFO - Completed processing callback for node 69a8d5bc911a9cbe7f77d634 2026-03-05 01:01:52,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:52,353 - lava_callback - INFO - Received callback for node 69a8d5a9911a9cbe7f77d5f2 INFO: 172.21.0.1:41658 - "POST /node/69a8d5a9911a9cbe7f77d5f2 HTTP/1.0" 202 Accepted 2026-03-05 01:01:52,360 - lava_callback - INFO - Starting async job submit for node 69a8d5a9911a9cbe7f77d5f2 2026-03-05 01:01:52,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 01:01:52,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:52,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5a9911a9cbe7f77d5f2 HTTP/1.1" 200 None 2026-03-05 01:01:52,398 - lava_callback - DEBUG - Processing node 69a8d5a9911a9cbe7f77d5f2: baseline-arm64 2026-03-05 01:01:52,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:52,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:52,932 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a9911a9cbe7f77d5f2/log.txt.gz 2026-03-05 01:01:53,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:53,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:53,364 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a9911a9cbe7f77d5f2/lava-logs.yaml 2026-03-05 01:01:53,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:53,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:53,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a9911a9cbe7f77d5f2/lava_callback.json.gz 2026-03-05 01:01:53,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:53,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5a9911a9cbe7f77d5f2 HTTP/1.1" 200 None 2026-03-05 01:01:53,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:53,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:53,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:53,662 - lava_callback - INFO - Received callback for node 69a8d5aa911a9cbe7f77d5f8 2026-03-05 01:01:53,673 - lava_callback - INFO - Starting async job submit for node 69a8d5aa911a9cbe7f77d5f8 INFO: 172.21.0.1:41662 - "POST /node/69a8d5aa911a9cbe7f77d5f8 HTTP/1.0" 202 Accepted 2026-03-05 01:01:53,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5a9911a9cbe7f77d5f2 HTTP/1.1" 200 None 2026-03-05 01:01:53,719 - lava_callback - INFO - Completed processing callback for node 69a8d5a9911a9cbe7f77d5f2 2026-03-05 01:01:53,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:53,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5aa911a9cbe7f77d5f8 HTTP/1.1" 200 None 2026-03-05 01:01:53,775 - lava_callback - DEBUG - Processing node 69a8d5aa911a9cbe7f77d5f8: baseline-arm64 2026-03-05 01:01:54,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:54,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:54,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5aa911a9cbe7f77d5f8/log.txt.gz 2026-03-05 01:01:54,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:54,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:54,543 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5aa911a9cbe7f77d5f8/lava-logs.yaml 2026-03-05 01:01:54,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:01:54,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:01:54,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5aa911a9cbe7f77d5f8/lava_callback.json.gz 2026-03-05 01:01:54,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:54,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5aa911a9cbe7f77d5f8 HTTP/1.1" 200 None 2026-03-05 01:01:54,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:54,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:01:54,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:01:54,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5aa911a9cbe7f77d5f8 HTTP/1.1" 200 None 2026-03-05 01:01:54,825 - lava_callback - INFO - Completed processing callback for node 69a8d5aa911a9cbe7f77d5f8 INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:02:04,186 - lava_callback - INFO - Received callback for node 69a8d5b4911a9cbe7f77d621 INFO: 172.21.0.1:59080 - "POST /node/69a8d5b4911a9cbe7f77d621 HTTP/1.0" 202 Accepted 2026-03-05 01:02:04,193 - lava_callback - INFO - Starting async job submit for node 69a8d5b4911a9cbe7f77d621 2026-03-05 01:02:04,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:04,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b4911a9cbe7f77d621 HTTP/1.1" 200 None 2026-03-05 01:02:04,232 - lava_callback - DEBUG - Processing node 69a8d5b4911a9cbe7f77d621: baseline-arm64 2026-03-05 01:02:04,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:04,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:04,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b4911a9cbe7f77d621/log.txt.gz 2026-03-05 01:02:05,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:05,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:05,231 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b4911a9cbe7f77d621/lava-logs.yaml 2026-03-05 01:02:05,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:05,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:05,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b4911a9cbe7f77d621/lava_callback.json.gz 2026-03-05 01:02:05,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:05,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b4911a9cbe7f77d621 HTTP/1.1" 200 None 2026-03-05 01:02:05,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:05,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:05,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:05,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5b4911a9cbe7f77d621 HTTP/1.1" 200 None 2026-03-05 01:02:05,494 - lava_callback - INFO - Completed processing callback for node 69a8d5b4911a9cbe7f77d621 INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:02:08,533 - lava_callback - INFO - Received callback for node 69a8d5ac911a9cbe7f77d5fe INFO: 172.21.0.1:59098 - "POST /node/69a8d5ac911a9cbe7f77d5fe HTTP/1.0" 202 Accepted 2026-03-05 01:02:08,543 - lava_callback - INFO - Starting async job submit for node 69a8d5ac911a9cbe7f77d5fe 2026-03-05 01:02:08,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:08,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ac911a9cbe7f77d5fe HTTP/1.1" 200 None 2026-03-05 01:02:08,608 - lava_callback - DEBUG - Processing node 69a8d5ac911a9cbe7f77d5fe: baseline-arm64 2026-03-05 01:02:08,750 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:02:08,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:09,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:09,275 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5ac911a9cbe7f77d5fe/lava-logs.yaml 2026-03-05 01:02:09,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:09,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:09,410 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5ac911a9cbe7f77d5fe/lava_callback.json.gz 2026-03-05 01:02:09,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:09,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ac911a9cbe7f77d5fe HTTP/1.1" 200 None 2026-03-05 01:02:09,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:09,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:09,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:09,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5ac911a9cbe7f77d5fe HTTP/1.1" 200 None 2026-03-05 01:02:09,568 - lava_callback - INFO - Completed processing callback for node 69a8d5ac911a9cbe7f77d5fe 2026-03-05 01:02:09,852 - lava_callback - INFO - Received callback for node 69a8d5ae911a9cbe7f77d612 INFO: 172.21.0.1:44144 - "POST /node/69a8d5ae911a9cbe7f77d612 HTTP/1.0" 202 Accepted 2026-03-05 01:02:09,859 - lava_callback - INFO - Starting async job submit for node 69a8d5ae911a9cbe7f77d612 2026-03-05 01:02:09,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:09,916 - lava_callback - INFO - Received callback for node 69a8d5b2911a9cbe7f77d61e INFO: 172.21.0.1:44152 - "POST /node/69a8d5b2911a9cbe7f77d61e HTTP/1.0" 202 Accepted 2026-03-05 01:02:09,929 - lava_callback - INFO - Starting async job submit for node 69a8d5b2911a9cbe7f77d61e 2026-03-05 01:02:09,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ae911a9cbe7f77d612 HTTP/1.1" 200 None 2026-03-05 01:02:09,964 - lava_callback - DEBUG - Processing node 69a8d5ae911a9cbe7f77d612: baseline-arm64 2026-03-05 01:02:10,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:10,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b2911a9cbe7f77d61e HTTP/1.1" 200 None 2026-03-05 01:02:10,092 - lava_callback - DEBUG - Processing node 69a8d5b2911a9cbe7f77d61e: baseline-arm64 2026-03-05 01:02:10,386 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:02:10,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:10,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:10,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:10,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5ae911a9cbe7f77d612/lava-logs.yaml 2026-03-05 01:02:10,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:10,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:10,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b2911a9cbe7f77d61e/log.txt.gz 2026-03-05 01:02:10,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:11,031 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5ae911a9cbe7f77d612/lava_callback.json.gz 2026-03-05 01:02:11,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:11,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ae911a9cbe7f77d612 HTTP/1.1" 200 None 2026-03-05 01:02:11,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:11,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:11,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:11,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:11,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5ae911a9cbe7f77d612 HTTP/1.1" 200 None 2026-03-05 01:02:11,345 - lava_callback - INFO - Completed processing callback for node 69a8d5ae911a9cbe7f77d612 2026-03-05 01:02:11,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:11,556 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b2911a9cbe7f77d61e/lava-logs.yaml 2026-03-05 01:02:11,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:11,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:11,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b2911a9cbe7f77d61e/lava_callback.json.gz 2026-03-05 01:02:11,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:11,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b2911a9cbe7f77d61e HTTP/1.1" 200 None 2026-03-05 01:02:11,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:11,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:11,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:11,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5b2911a9cbe7f77d61e HTTP/1.1" 200 None 2026-03-05 01:02:11,865 - lava_callback - INFO - Completed processing callback for node 69a8d5b2911a9cbe7f77d61e INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:02:16,631 - lava_callback - INFO - Received callback for node 69a8d5b1911a9cbe7f77d61a INFO: 172.21.0.1:44182 - "POST /node/69a8d5b1911a9cbe7f77d61a HTTP/1.0" 202 Accepted 2026-03-05 01:02:16,637 - lava_callback - INFO - Starting async job submit for node 69a8d5b1911a9cbe7f77d61a 2026-03-05 01:02:16,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:16,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b1911a9cbe7f77d61a HTTP/1.1" 200 None 2026-03-05 01:02:16,674 - lava_callback - DEBUG - Processing node 69a8d5b1911a9cbe7f77d61a: baseline-arm64 2026-03-05 01:02:16,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:17,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:17,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b1911a9cbe7f77d61a/log.txt.gz 2026-03-05 01:02:17,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:17,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:17,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b1911a9cbe7f77d61a/lava-logs.yaml 2026-03-05 01:02:17,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:17,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:17,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b1911a9cbe7f77d61a/lava_callback.json.gz 2026-03-05 01:02:17,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:17,604 - lava_callback - INFO - Received callback for node 69a8d5bd911a9cbe7f77d637 INFO: 172.21.0.1:44198 - "POST /node/69a8d5bd911a9cbe7f77d637 HTTP/1.0" 202 Accepted 2026-03-05 01:02:17,610 - lava_callback - INFO - Starting async job submit for node 69a8d5bd911a9cbe7f77d637 2026-03-05 01:02:17,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:17,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5bd911a9cbe7f77d637 HTTP/1.1" 200 None 2026-03-05 01:02:17,649 - lava_callback - DEBUG - Processing node 69a8d5bd911a9cbe7f77d637: baseline-arm64 2026-03-05 01:02:17,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b1911a9cbe7f77d61a HTTP/1.1" 200 None 2026-03-05 01:02:17,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:17,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:17,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:17,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5b1911a9cbe7f77d61a HTTP/1.1" 200 None 2026-03-05 01:02:17,938 - lava_callback - INFO - Completed processing callback for node 69a8d5b1911a9cbe7f77d61a 2026-03-05 01:02:17,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:18,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:18,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bd911a9cbe7f77d637/log.txt.gz 2026-03-05 01:02:18,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:18,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:18,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bd911a9cbe7f77d637/lava-logs.yaml 2026-03-05 01:02:18,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:18,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:18,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bd911a9cbe7f77d637/lava_callback.json.gz 2026-03-05 01:02:18,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:18,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5bd911a9cbe7f77d637 HTTP/1.1" 200 None 2026-03-05 01:02:18,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:18,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:18,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:18,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5bd911a9cbe7f77d637 HTTP/1.1" 200 None 2026-03-05 01:02:18,731 - lava_callback - INFO - Completed processing callback for node 69a8d5bd911a9cbe7f77d637 2026-03-05 01:02:19,793 - lava_callback - INFO - Received callback for node 69a8d5a7911a9cbe7f77d5ef INFO: 172.21.0.1:36716 - "POST /node/69a8d5a7911a9cbe7f77d5ef HTTP/1.0" 202 Accepted 2026-03-05 01:02:19,799 - lava_callback - INFO - Starting async job submit for node 69a8d5a7911a9cbe7f77d5ef 2026-03-05 01:02:19,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:19,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5a7911a9cbe7f77d5ef HTTP/1.1" 200 None 2026-03-05 01:02:19,839 - lava_callback - DEBUG - Processing node 69a8d5a7911a9cbe7f77d5ef: baseline-arm64 2026-03-05 01:02:20,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:20,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:20,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a7911a9cbe7f77d5ef/log.txt.gz 2026-03-05 01:02:20,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:20,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:20,583 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a7911a9cbe7f77d5ef/lava-logs.yaml 2026-03-05 01:02:20,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:20,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:20,730 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5a7911a9cbe7f77d5ef/lava_callback.json.gz 2026-03-05 01:02:20,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:20,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5a7911a9cbe7f77d5ef HTTP/1.1" 200 None 2026-03-05 01:02:20,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:20,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:20,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:20,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5a7911a9cbe7f77d5ef HTTP/1.1" 200 None 2026-03-05 01:02:20,822 - lava_callback - INFO - Completed processing callback for node 69a8d5a7911a9cbe7f77d5ef 2026-03-05 01:02:22,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:22,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:02:27,389 - lava_callback - INFO - Received callback for node 69a8d5cb911a9cbe7f77d656 INFO: 172.21.0.1:36740 - "POST /node/69a8d5cb911a9cbe7f77d656 HTTP/1.0" 202 Accepted 2026-03-05 01:02:27,399 - lava_callback - INFO - Starting async job submit for node 69a8d5cb911a9cbe7f77d656 2026-03-05 01:02:27,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:27,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5cb911a9cbe7f77d656 HTTP/1.1" 200 None 2026-03-05 01:02:27,445 - lava_callback - DEBUG - Processing node 69a8d5cb911a9cbe7f77d656: baseline-nfs-arm64 2026-03-05 01:02:27,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:28,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:28,118 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cb911a9cbe7f77d656/log.txt.gz 2026-03-05 01:02:28,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:28,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:28,623 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cb911a9cbe7f77d656/lava-logs.yaml 2026-03-05 01:02:28,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:28,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:28,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cb911a9cbe7f77d656/lava_callback.json.gz 2026-03-05 01:02:28,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:28,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5cb911a9cbe7f77d656 HTTP/1.1" 200 None 2026-03-05 01:02:28,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:28,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:28,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:28,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5cb911a9cbe7f77d656 HTTP/1.1" 200 None 2026-03-05 01:02:28,898 - lava_callback - INFO - Completed processing callback for node 69a8d5cb911a9cbe7f77d656 2026-03-05 01:02:31,034 - lava_callback - INFO - Received callback for node 69a8d5cc911a9cbe7f77d67c INFO: 172.21.0.1:36958 - "POST /node/69a8d5cc911a9cbe7f77d67c HTTP/1.0" 202 Accepted 2026-03-05 01:02:31,046 - lava_callback - INFO - Starting async job submit for node 69a8d5cc911a9cbe7f77d67c 2026-03-05 01:02:31,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:31,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5cc911a9cbe7f77d67c HTTP/1.1" 200 None 2026-03-05 01:02:31,089 - lava_callback - DEBUG - Processing node 69a8d5cc911a9cbe7f77d67c: baseline-nfs-arm64 2026-03-05 01:02:31,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:31,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:31,937 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cc911a9cbe7f77d67c/log.txt.gz 2026-03-05 01:02:32,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:32,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:32,456 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cc911a9cbe7f77d67c/lava-logs.yaml 2026-03-05 01:02:32,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:32,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:32,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cc911a9cbe7f77d67c/lava_callback.json.gz 2026-03-05 01:02:32,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:32,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5cc911a9cbe7f77d67c HTTP/1.1" 200 None 2026-03-05 01:02:32,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:32,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:32,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:32,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5cc911a9cbe7f77d67c HTTP/1.1" 200 None 2026-03-05 01:02:32,793 - lava_callback - INFO - Completed processing callback for node 69a8d5cc911a9cbe7f77d67c INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:02:37,395 - lava_callback - INFO - Received callback for node 69a8d5b8911a9cbe7f77d62e INFO: 172.21.0.1:36976 - "POST /node/69a8d5b8911a9cbe7f77d62e HTTP/1.0" 202 Accepted 2026-03-05 01:02:37,402 - lava_callback - INFO - Starting async job submit for node 69a8d5b8911a9cbe7f77d62e 2026-03-05 01:02:37,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:37,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b8911a9cbe7f77d62e HTTP/1.1" 200 None 2026-03-05 01:02:37,441 - lava_callback - DEBUG - Processing node 69a8d5b8911a9cbe7f77d62e: baseline-arm64 2026-03-05 01:02:37,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:37,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:37,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b8911a9cbe7f77d62e/log.txt.gz 2026-03-05 01:02:37,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:38,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:38,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b8911a9cbe7f77d62e/lava-logs.yaml 2026-03-05 01:02:38,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:38,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:38,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b8911a9cbe7f77d62e/lava_callback.json.gz 2026-03-05 01:02:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:38,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b8911a9cbe7f77d62e HTTP/1.1" 200 None 2026-03-05 01:02:38,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:38,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:38,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:38,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5b8911a9cbe7f77d62e HTTP/1.1" 200 None 2026-03-05 01:02:38,361 - lava_callback - INFO - Completed processing callback for node 69a8d5b8911a9cbe7f77d62e 2026-03-05 01:02:44,396 - lava_callback - INFO - Received callback for node 69a8d5bf911a9cbe7f77d63a INFO: 172.21.0.1:34250 - "POST /node/69a8d5bf911a9cbe7f77d63a HTTP/1.0" 202 Accepted 2026-03-05 01:02:44,403 - lava_callback - INFO - Starting async job submit for node 69a8d5bf911a9cbe7f77d63a 2026-03-05 01:02:44,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:44,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5bf911a9cbe7f77d63a HTTP/1.1" 200 None 2026-03-05 01:02:44,441 - lava_callback - DEBUG - Processing node 69a8d5bf911a9cbe7f77d63a: baseline-arm64 2026-03-05 01:02:44,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:44,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:44,920 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bf911a9cbe7f77d63a/log.txt.gz 2026-03-05 01:02:45,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:45,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:45,324 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bf911a9cbe7f77d63a/lava-logs.yaml 2026-03-05 01:02:45,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:45,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:45,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5bf911a9cbe7f77d63a/lava_callback.json.gz 2026-03-05 01:02:45,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:45,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5bf911a9cbe7f77d63a HTTP/1.1" 200 None 2026-03-05 01:02:45,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:45,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:45,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:45,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5bf911a9cbe7f77d63a HTTP/1.1" 200 None 2026-03-05 01:02:45,548 - lava_callback - INFO - Completed processing callback for node 69a8d5bf911a9cbe7f77d63a INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:02:46,600 - lava_callback - INFO - Received callback for node 69a8d5d4911a9cbe7f77d690 INFO: 172.21.0.1:34264 - "POST /node/69a8d5d4911a9cbe7f77d690 HTTP/1.0" 202 Accepted 2026-03-05 01:02:46,607 - lava_callback - INFO - Starting async job submit for node 69a8d5d4911a9cbe7f77d690 2026-03-05 01:02:46,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:46,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d4911a9cbe7f77d690 HTTP/1.1" 200 None 2026-03-05 01:02:46,645 - lava_callback - DEBUG - Processing node 69a8d5d4911a9cbe7f77d690: baseline-nfs-arm64 2026-03-05 01:02:46,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:47,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:47,132 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d4911a9cbe7f77d690/log.txt.gz 2026-03-05 01:02:47,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:47,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:47,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d4911a9cbe7f77d690/lava-logs.yaml 2026-03-05 01:02:47,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:47,616 - lava_callback - INFO - Received callback for node 69a8d600911a9cbe7f77d71c INFO: 172.21.0.1:34266 - "POST /node/69a8d600911a9cbe7f77d71c HTTP/1.0" 202 Accepted 2026-03-05 01:02:47,627 - lava_callback - INFO - Starting async job submit for node 69a8d600911a9cbe7f77d71c 2026-03-05 01:02:47,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:47,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d600911a9cbe7f77d71c HTTP/1.1" 200 None 2026-03-05 01:02:47,676 - lava_callback - DEBUG - Processing node 69a8d600911a9cbe7f77d71c: baseline-arm64-foundriesio 2026-03-05 01:02:47,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:47,759 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d4911a9cbe7f77d690/lava_callback.json.gz 2026-03-05 01:02:47,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:47,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d4911a9cbe7f77d690 HTTP/1.1" 200 None 2026-03-05 01:02:47,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:47,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:47,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:47,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:47,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5d4911a9cbe7f77d690 HTTP/1.1" 200 None 2026-03-05 01:02:47,994 - lava_callback - INFO - Completed processing callback for node 69a8d5d4911a9cbe7f77d690 2026-03-05 01:02:48,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:48,131 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8d600911a9cbe7f77d71c/log.txt.gz 2026-03-05 01:02:48,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:48,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:48,478 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8d600911a9cbe7f77d71c/lava-logs.yaml 2026-03-05 01:02:48,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:48,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:48,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8d600911a9cbe7f77d71c/lava_callback.json.gz 2026-03-05 01:02:48,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:48,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d600911a9cbe7f77d71c HTTP/1.1" 200 None 2026-03-05 01:02:48,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:48,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:48,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:48,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d600911a9cbe7f77d71c HTTP/1.1" 200 None 2026-03-05 01:02:48,735 - lava_callback - INFO - Completed processing callback for node 69a8d600911a9cbe7f77d71c 2026-03-05 01:02:49,432 - lava_callback - INFO - Received callback for node 69a8d5e1911a9cbe7f77d6a7 INFO: 172.21.0.1:34276 - "POST /node/69a8d5e1911a9cbe7f77d6a7 HTTP/1.0" 202 Accepted 2026-03-05 01:02:49,439 - lava_callback - INFO - Starting async job submit for node 69a8d5e1911a9cbe7f77d6a7 2026-03-05 01:02:49,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:49,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5e1911a9cbe7f77d6a7 HTTP/1.1" 200 None 2026-03-05 01:02:49,476 - lava_callback - DEBUG - Processing node 69a8d5e1911a9cbe7f77d6a7: baseline-arm64-broonie 2026-03-05 01:02:49,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:49,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:49,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5e1911a9cbe7f77d6a7/log.txt.gz 2026-03-05 01:02:49,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:50,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:50,192 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5e1911a9cbe7f77d6a7/lava-logs.yaml 2026-03-05 01:02:50,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:02:50,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:02:50,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5e1911a9cbe7f77d6a7/lava_callback.json.gz 2026-03-05 01:02:50,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:50,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5e1911a9cbe7f77d6a7 HTTP/1.1" 200 None 2026-03-05 01:02:50,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:50,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:02:50,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:50,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5e1911a9cbe7f77d6a7 HTTP/1.1" 200 None 2026-03-05 01:02:50,458 - lava_callback - INFO - Completed processing callback for node 69a8d5e1911a9cbe7f77d6a7 2026-03-05 01:02:52,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:02:52,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:03:04,300 - lava_callback - INFO - Received callback for node 69a8d5ba911a9cbe7f77d631 INFO: 172.21.0.1:33740 - "POST /node/69a8d5ba911a9cbe7f77d631 HTTP/1.0" 202 Accepted 2026-03-05 01:03:04,307 - lava_callback - INFO - Starting async job submit for node 69a8d5ba911a9cbe7f77d631 2026-03-05 01:03:04,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:04,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ba911a9cbe7f77d631 HTTP/1.1" 200 None 2026-03-05 01:03:04,343 - lava_callback - DEBUG - Processing node 69a8d5ba911a9cbe7f77d631: baseline-arm64 2026-03-05 01:03:05,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:05,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:05,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5ba911a9cbe7f77d631/log.txt.gz 2026-03-05 01:03:05,528 - lava_callback - INFO - Received callback for node 69a8d5fc911a9cbe7f77d707 INFO: 172.21.0.1:33756 - "POST /node/69a8d5fc911a9cbe7f77d707 HTTP/1.0" 202 Accepted 2026-03-05 01:03:05,548 - lava_callback - INFO - Starting async job submit for node 69a8d5fc911a9cbe7f77d707 2026-03-05 01:03:05,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:05,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:05,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5fc911a9cbe7f77d707 HTTP/1.1" 200 None 2026-03-05 01:03:05,632 - lava_callback - DEBUG - Processing node 69a8d5fc911a9cbe7f77d707: baseline-arm64-pengutronix 2026-03-05 01:03:05,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:05,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:05,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5ba911a9cbe7f77d631/lava-logs.yaml 2026-03-05 01:03:05,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:05,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:05,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5fc911a9cbe7f77d707/log.txt.gz 2026-03-05 01:03:06,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:06,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:06,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5ba911a9cbe7f77d631/lava_callback.json.gz 2026-03-05 01:03:06,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:06,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ba911a9cbe7f77d631 HTTP/1.1" 200 None 2026-03-05 01:03:06,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:06,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:06,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:06,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5ba911a9cbe7f77d631 HTTP/1.1" 200 None 2026-03-05 01:03:06,192 - lava_callback - INFO - Completed processing callback for node 69a8d5ba911a9cbe7f77d631 2026-03-05 01:03:06,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:06,340 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5fc911a9cbe7f77d707/lava-logs.yaml 2026-03-05 01:03:06,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:06,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:06,503 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5fc911a9cbe7f77d707/lava_callback.json.gz INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:03:06,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:06,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5fc911a9cbe7f77d707 HTTP/1.1" 200 None 2026-03-05 01:03:06,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:06,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:06,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:06,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5fc911a9cbe7f77d707 HTTP/1.1" 200 None 2026-03-05 01:03:06,626 - lava_callback - INFO - Completed processing callback for node 69a8d5fc911a9cbe7f77d707 2026-03-05 01:03:08,758 - lava_callback - INFO - Received callback for node 69a8d5d2911a9cbe7f77d68c INFO: 172.21.0.1:33772 - "POST /node/69a8d5d2911a9cbe7f77d68c HTTP/1.0" 202 Accepted 2026-03-05 01:03:08,765 - lava_callback - INFO - Starting async job submit for node 69a8d5d2911a9cbe7f77d68c 2026-03-05 01:03:08,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:08,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d2911a9cbe7f77d68c HTTP/1.1" 200 None 2026-03-05 01:03:08,804 - lava_callback - DEBUG - Processing node 69a8d5d2911a9cbe7f77d68c: baseline-nfs-arm64 2026-03-05 01:03:09,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:09,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:09,372 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d2911a9cbe7f77d68c/log.txt.gz 2026-03-05 01:03:09,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:09,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:09,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d2911a9cbe7f77d68c/lava-logs.yaml 2026-03-05 01:03:09,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:10,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:10,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d2911a9cbe7f77d68c/lava_callback.json.gz 2026-03-05 01:03:10,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:10,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d2911a9cbe7f77d68c HTTP/1.1" 200 None 2026-03-05 01:03:10,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:10,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:10,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:10,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5d2911a9cbe7f77d68c HTTP/1.1" 200 None 2026-03-05 01:03:10,182 - lava_callback - INFO - Completed processing callback for node 69a8d5d2911a9cbe7f77d68c 2026-03-05 01:03:10,224 - lava_callback - INFO - Received callback for node 69a8d5d6911a9cbe7f77d693 INFO: 172.21.0.1:43858 - "POST /node/69a8d5d6911a9cbe7f77d693 HTTP/1.0" 202 Accepted 2026-03-05 01:03:10,236 - lava_callback - INFO - Starting async job submit for node 69a8d5d6911a9cbe7f77d693 2026-03-05 01:03:10,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:10,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d6911a9cbe7f77d693 HTTP/1.1" 200 None 2026-03-05 01:03:10,334 - lava_callback - DEBUG - Processing node 69a8d5d6911a9cbe7f77d693: baseline-nfs-arm64 2026-03-05 01:03:10,953 - lava_callback - INFO - Received callback for node 69a8d5eb911a9cbe7f77d6e5 INFO: 172.21.0.1:43868 - "POST /node/69a8d5eb911a9cbe7f77d6e5 HTTP/1.0" 202 Accepted 2026-03-05 01:03:10,979 - lava_callback - INFO - Starting async job submit for node 69a8d5eb911a9cbe7f77d6e5 2026-03-05 01:03:11,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:11,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:11,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5eb911a9cbe7f77d6e5 HTTP/1.1" 200 None 2026-03-05 01:03:11,032 - lava_callback - DEBUG - Processing node 69a8d5eb911a9cbe7f77d6e5: baseline-arm64-broonie 2026-03-05 01:03:11,182 - lava_callback - INFO - Received callback for node 69a8d5cf911a9cbe7f77d686 2026-03-05 01:03:11,207 - lava_callback - INFO - Starting async job submit for node 69a8d5cf911a9cbe7f77d686 2026-03-05 01:03:11,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:43880 - "POST /node/69a8d5cf911a9cbe7f77d686 HTTP/1.0" 202 Accepted 2026-03-05 01:03:11,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:11,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d6911a9cbe7f77d693/log.txt.gz 2026-03-05 01:03:11,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5cf911a9cbe7f77d686 HTTP/1.1" 200 None 2026-03-05 01:03:11,497 - lava_callback - DEBUG - Processing node 69a8d5cf911a9cbe7f77d686: baseline-nfs-arm64 2026-03-05 01:03:11,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:11,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:12,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:12,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5eb911a9cbe7f77d6e5/log.txt.gz 2026-03-05 01:03:12,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:12,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:12,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d6911a9cbe7f77d693/lava-logs.yaml 2026-03-05 01:03:12,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:12,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:12,387 - lava_callback - INFO - Received callback for node 69a8d5c7911a9cbe7f77d64c 2026-03-05 01:03:12,427 - lava_callback - INFO - Starting async job submit for node 69a8d5c7911a9cbe7f77d64c INFO: 172.21.0.1:43894 - "POST /node/69a8d5c7911a9cbe7f77d64c HTTP/1.0" 202 Accepted 2026-03-05 01:03:12,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:12,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:12,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cf911a9cbe7f77d686/log.txt.gz 2026-03-05 01:03:12,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c7911a9cbe7f77d64c HTTP/1.1" 200 None 2026-03-05 01:03:12,532 - lava_callback - DEBUG - Processing node 69a8d5c7911a9cbe7f77d64c: baseline-nfs-arm64 2026-03-05 01:03:12,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:12,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d6911a9cbe7f77d693/lava_callback.json.gz 2026-03-05 01:03:12,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:12,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5eb911a9cbe7f77d6e5/lava-logs.yaml 2026-03-05 01:03:12,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:12,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:12,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d6911a9cbe7f77d693 HTTP/1.1" 200 None 2026-03-05 01:03:12,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:13,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:13,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:13,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:13,191 - lava_callback - INFO - Received callback for node 69a8d5b5911a9cbe7f77d624 2026-03-05 01:03:13,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:13,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5eb911a9cbe7f77d6e5/lava_callback.json.gz 2026-03-05 01:03:13,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5d6911a9cbe7f77d693 HTTP/1.1" 200 None 2026-03-05 01:03:13,246 - lava_callback - INFO - Completed processing callback for node 69a8d5d6911a9cbe7f77d693 INFO: 172.21.0.1:43902 - "POST /node/69a8d5b5911a9cbe7f77d624 HTTP/1.0" 202 Accepted 2026-03-05 01:03:13,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:13,277 - lava_callback - INFO - Starting async job submit for node 69a8d5b5911a9cbe7f77d624 2026-03-05 01:03:13,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:13,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:13,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b5911a9cbe7f77d624 HTTP/1.1" 200 None 2026-03-05 01:03:13,407 - lava_callback - DEBUG - Processing node 69a8d5b5911a9cbe7f77d624: baseline-arm64 2026-03-05 01:03:13,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5eb911a9cbe7f77d6e5 HTTP/1.1" 200 None 2026-03-05 01:03:13,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:13,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:13,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:13,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:13,535 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cf911a9cbe7f77d686/lava-logs.yaml 2026-03-05 01:03:13,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5eb911a9cbe7f77d6e5 HTTP/1.1" 200 None 2026-03-05 01:03:13,588 - lava_callback - INFO - Completed processing callback for node 69a8d5eb911a9cbe7f77d6e5 2026-03-05 01:03:13,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:13,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:13,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c7911a9cbe7f77d64c/log.txt.gz 2026-03-05 01:03:13,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:14,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5cf911a9cbe7f77d686/lava_callback.json.gz INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:03:14,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:14,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:14,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5cf911a9cbe7f77d686 HTTP/1.1" 200 None 2026-03-05 01:03:14,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:14,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:14,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:14,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:14,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5cf911a9cbe7f77d686 HTTP/1.1" 200 None 2026-03-05 01:03:14,390 - lava_callback - INFO - Completed processing callback for node 69a8d5cf911a9cbe7f77d686 2026-03-05 01:03:14,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:14,510 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c7911a9cbe7f77d64c/lava-logs.yaml 2026-03-05 01:03:14,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:14,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:14,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b5911a9cbe7f77d624/log.txt.gz 2026-03-05 01:03:14,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:14,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c7911a9cbe7f77d64c/lava_callback.json.gz 2026-03-05 01:03:14,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:14,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c7911a9cbe7f77d64c HTTP/1.1" 200 None 2026-03-05 01:03:14,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:14,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:14,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:14,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:14,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5c7911a9cbe7f77d64c HTTP/1.1" 200 None 2026-03-05 01:03:14,995 - lava_callback - INFO - Completed processing callback for node 69a8d5c7911a9cbe7f77d64c INFO: 172.21.0.1:43914 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-05 01:03:15,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:15,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b5911a9cbe7f77d624/lava-logs.yaml 2026-03-05 01:03:15,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:15,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:15,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5b5911a9cbe7f77d624/lava_callback.json.gz 2026-03-05 01:03:15,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:15,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b5911a9cbe7f77d624 HTTP/1.1" 200 None 2026-03-05 01:03:15,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:15,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:15,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:15,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5b5911a9cbe7f77d624 HTTP/1.1" 200 None 2026-03-05 01:03:15,588 - lava_callback - INFO - Completed processing callback for node 69a8d5b5911a9cbe7f77d624 2026-03-05 01:03:16,472 - lava_callback - INFO - Received callback for node 69a8d5fd911a9cbe7f77d70e INFO: 172.21.0.1:43928 - "POST /node/69a8d5fd911a9cbe7f77d70e HTTP/1.0" 202 Accepted 2026-03-05 01:03:16,483 - lava_callback - INFO - Starting async job submit for node 69a8d5fd911a9cbe7f77d70e INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:03:16,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:16,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5fd911a9cbe7f77d70e HTTP/1.1" 200 None 2026-03-05 01:03:16,541 - lava_callback - DEBUG - Processing node 69a8d5fd911a9cbe7f77d70e: baseline-arm64-pengutronix 2026-03-05 01:03:16,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:16,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:16,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5fd911a9cbe7f77d70e/log.txt.gz 2026-03-05 01:03:17,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:17,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:17,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5fd911a9cbe7f77d70e/lava-logs.yaml 2026-03-05 01:03:17,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:17,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:17,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5fd911a9cbe7f77d70e/lava_callback.json.gz 2026-03-05 01:03:17,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:17,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5fd911a9cbe7f77d70e HTTP/1.1" 200 None 2026-03-05 01:03:17,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:17,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:17,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:17,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5fd911a9cbe7f77d70e HTTP/1.1" 200 None 2026-03-05 01:03:17,534 - lava_callback - INFO - Completed processing callback for node 69a8d5fd911a9cbe7f77d70e 2026-03-05 01:03:20,347 - lava_callback - INFO - Received callback for node 69a8d5d0911a9cbe7f77d689 INFO: 172.21.0.1:41404 - "POST /node/69a8d5d0911a9cbe7f77d689 HTTP/1.0" 202 Accepted 2026-03-05 01:03:20,355 - lava_callback - INFO - Starting async job submit for node 69a8d5d0911a9cbe7f77d689 2026-03-05 01:03:20,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:20,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d0911a9cbe7f77d689 HTTP/1.1" 200 None 2026-03-05 01:03:20,394 - lava_callback - DEBUG - Processing node 69a8d5d0911a9cbe7f77d689: baseline-nfs-arm64 2026-03-05 01:03:20,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:21,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:21,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d0911a9cbe7f77d689/log.txt.gz 2026-03-05 01:03:21,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:21,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:21,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d0911a9cbe7f77d689/lava-logs.yaml 2026-03-05 01:03:21,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:21,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:21,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5d0911a9cbe7f77d689/lava_callback.json.gz 2026-03-05 01:03:21,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:21,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5d0911a9cbe7f77d689 HTTP/1.1" 200 None 2026-03-05 01:03:21,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:21,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:21,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5d0911a9cbe7f77d689 HTTP/1.1" 200 None 2026-03-05 01:03:21,976 - lava_callback - INFO - Completed processing callback for node 69a8d5d0911a9cbe7f77d689 2026-03-05 01:03:22,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:22,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-05 01:03:25,288 - lava_callback - INFO - Received callback for node 69a8d5ff911a9cbe7f77d711 INFO: 172.21.0.1:41414 - "POST /node/69a8d5ff911a9cbe7f77d711 HTTP/1.0" 202 Accepted 2026-03-05 01:03:25,295 - lava_callback - INFO - Starting async job submit for node 69a8d5ff911a9cbe7f77d711 2026-03-05 01:03:25,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:25,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ff911a9cbe7f77d711 HTTP/1.1" 200 None 2026-03-05 01:03:25,333 - lava_callback - DEBUG - Processing node 69a8d5ff911a9cbe7f77d711: baseline-arm64-pengutronix 2026-03-05 01:03:25,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:25,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:25,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5ff911a9cbe7f77d711/log.txt.gz 2026-03-05 01:03:25,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:26,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:26,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5ff911a9cbe7f77d711/lava-logs.yaml 2026-03-05 01:03:26,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:26,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:26,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69a8d5ff911a9cbe7f77d711/lava_callback.json.gz 2026-03-05 01:03:26,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:26,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ff911a9cbe7f77d711 HTTP/1.1" 200 None 2026-03-05 01:03:26,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:26,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:26,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:26,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5ff911a9cbe7f77d711 HTTP/1.1" 200 None 2026-03-05 01:03:26,319 - lava_callback - INFO - Completed processing callback for node 69a8d5ff911a9cbe7f77d711 INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:03:30,206 - lava_callback - INFO - Received callback for node 69a8d5f5911a9cbe7f77d6f6 INFO: 172.21.0.1:50608 - "POST /node/69a8d5f5911a9cbe7f77d6f6 HTTP/1.0" 202 Accepted 2026-03-05 01:03:30,213 - lava_callback - INFO - Starting async job submit for node 69a8d5f5911a9cbe7f77d6f6 2026-03-05 01:03:30,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:30,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f5911a9cbe7f77d6f6 HTTP/1.1" 200 None 2026-03-05 01:03:30,270 - lava_callback - DEBUG - Processing node 69a8d5f5911a9cbe7f77d6f6: baseline-arm64-clabbe 2026-03-05 01:03:30,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:30,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:30,811 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f5911a9cbe7f77d6f6/log.txt.gz 2026-03-05 01:03:30,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:31,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:31,123 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f5911a9cbe7f77d6f6/lava-logs.yaml 2026-03-05 01:03:31,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:31,149 - lava_callback - INFO - Received callback for node 69a8d5c2911a9cbe7f77d640 INFO: 172.21.0.1:50616 - "POST /node/69a8d5c2911a9cbe7f77d640 HTTP/1.0" 202 Accepted 2026-03-05 01:03:31,156 - lava_callback - INFO - Starting async job submit for node 69a8d5c2911a9cbe7f77d640 2026-03-05 01:03:31,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:31,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c2911a9cbe7f77d640 HTTP/1.1" 200 None 2026-03-05 01:03:31,215 - lava_callback - DEBUG - Processing node 69a8d5c2911a9cbe7f77d640: baseline-nfs-arm64 2026-03-05 01:03:31,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:31,351 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f5911a9cbe7f77d6f6/lava_callback.json.gz 2026-03-05 01:03:31,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:31,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f5911a9cbe7f77d6f6 HTTP/1.1" 200 None 2026-03-05 01:03:31,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:31,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:31,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:31,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5f5911a9cbe7f77d6f6 HTTP/1.1" 200 None 2026-03-05 01:03:31,728 - lava_callback - INFO - Completed processing callback for node 69a8d5f5911a9cbe7f77d6f6 2026-03-05 01:03:31,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:32,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:32,021 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c2911a9cbe7f77d640/log.txt.gz 2026-03-05 01:03:32,208 - lava_callback - INFO - Received callback for node 69a8d64d911a9cbe7f77d7d5 INFO: 172.21.0.1:50626 - "POST /node/69a8d64d911a9cbe7f77d7d5 HTTP/1.0" 202 Accepted 2026-03-05 01:03:32,230 - lava_callback - INFO - Starting async job submit for node 69a8d64d911a9cbe7f77d7d5 2026-03-05 01:03:32,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:32,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64d911a9cbe7f77d7d5 HTTP/1.1" 200 None 2026-03-05 01:03:32,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:32,310 - lava_callback - DEBUG - Processing node 69a8d64d911a9cbe7f77d7d5: baseline-arm 2026-03-05 01:03:32,316 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:03:32,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:32,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:32,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64d911a9cbe7f77d7d5/lava-logs.yaml 2026-03-05 01:03:32,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:32,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:32,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64d911a9cbe7f77d7d5/lava_callback.json.gz 2026-03-05 01:03:32,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:32,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:32,588 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c2911a9cbe7f77d640/lava-logs.yaml 2026-03-05 01:03:32,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:32,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64d911a9cbe7f77d7d5 HTTP/1.1" 200 None 2026-03-05 01:03:32,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:32,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:03:32,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:32,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d64d911a9cbe7f77d7d5 HTTP/1.1" 200 None 2026-03-05 01:03:32,674 - lava_callback - INFO - Completed processing callback for node 69a8d64d911a9cbe7f77d7d5 2026-03-05 01:03:32,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:32,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c2911a9cbe7f77d640/lava_callback.json.gz 2026-03-05 01:03:32,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:32,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c2911a9cbe7f77d640 HTTP/1.1" 200 None 2026-03-05 01:03:32,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:32,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:32,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:32,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5c2911a9cbe7f77d640 HTTP/1.1" 200 None 2026-03-05 01:03:32,993 - lava_callback - INFO - Completed processing callback for node 69a8d5c2911a9cbe7f77d640 INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:03:38,084 - lava_callback - INFO - Received callback for node 69a8d5f1911a9cbe7f77d6ee INFO: 172.21.0.1:50644 - "POST /node/69a8d5f1911a9cbe7f77d6ee HTTP/1.0" 202 Accepted 2026-03-05 01:03:38,090 - lava_callback - INFO - Starting async job submit for node 69a8d5f1911a9cbe7f77d6ee 2026-03-05 01:03:38,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:38,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f1911a9cbe7f77d6ee HTTP/1.1" 200 None 2026-03-05 01:03:38,177 - lava_callback - DEBUG - Processing node 69a8d5f1911a9cbe7f77d6ee: baseline-arm64-clabbe 2026-03-05 01:03:38,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:38,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:38,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f1911a9cbe7f77d6ee/log.txt.gz 2026-03-05 01:03:38,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:38,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:38,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f1911a9cbe7f77d6ee/lava-logs.yaml 2026-03-05 01:03:38,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:39,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:39,142 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f1911a9cbe7f77d6ee/lava_callback.json.gz 2026-03-05 01:03:39,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:39,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f1911a9cbe7f77d6ee HTTP/1.1" 200 None 2026-03-05 01:03:39,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:39,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:39,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:39,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5f1911a9cbe7f77d6ee HTTP/1.1" 200 None 2026-03-05 01:03:39,242 - lava_callback - INFO - Completed processing callback for node 69a8d5f1911a9cbe7f77d6ee 2026-03-05 01:03:42,651 - lava_callback - INFO - Received callback for node 69a8d64d911a9cbe7f77d7d8 INFO: 172.21.0.1:50344 - "POST /node/69a8d64d911a9cbe7f77d7d8 HTTP/1.0" 202 Accepted 2026-03-05 01:03:42,698 - lava_callback - INFO - Starting async job submit for node 69a8d64d911a9cbe7f77d7d8 2026-03-05 01:03:42,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:42,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64d911a9cbe7f77d7d8 HTTP/1.1" 200 None 2026-03-05 01:03:42,732 - lava_callback - DEBUG - Processing node 69a8d64d911a9cbe7f77d7d8: baseline-arm 2026-03-05 01:03:42,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:43,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:43,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64d911a9cbe7f77d7d8/log.txt.gz 2026-03-05 01:03:43,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:43,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:43,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64d911a9cbe7f77d7d8/lava-logs.yaml 2026-03-05 01:03:43,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:43,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:43,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64d911a9cbe7f77d7d8/lava_callback.json.gz 2026-03-05 01:03:43,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:43,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64d911a9cbe7f77d7d8 HTTP/1.1" 200 None 2026-03-05 01:03:43,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:43,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:03:43,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:43,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d64d911a9cbe7f77d7d8 HTTP/1.1" 200 None 2026-03-05 01:03:43,542 - lava_callback - INFO - Completed processing callback for node 69a8d64d911a9cbe7f77d7d8 2026-03-05 01:03:45,712 - lava_callback - INFO - Received callback for node 69a8d5f4911a9cbe7f77d6f3 INFO: 172.21.0.1:50356 - "POST /node/69a8d5f4911a9cbe7f77d6f3 HTTP/1.0" 202 Accepted 2026-03-05 01:03:45,718 - lava_callback - INFO - Starting async job submit for node 69a8d5f4911a9cbe7f77d6f3 2026-03-05 01:03:45,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:45,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f4911a9cbe7f77d6f3 HTTP/1.1" 200 None 2026-03-05 01:03:45,763 - lava_callback - DEBUG - Processing node 69a8d5f4911a9cbe7f77d6f3: baseline-arm64-clabbe 2026-03-05 01:03:46,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:46,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:46,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f4911a9cbe7f77d6f3/log.txt.gz INFO: 172.21.0.1:50370 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:03:46,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:46,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:46,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f4911a9cbe7f77d6f3/lava-logs.yaml 2026-03-05 01:03:46,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:47,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:47,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f4911a9cbe7f77d6f3/lava_callback.json.gz 2026-03-05 01:03:47,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:47,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f4911a9cbe7f77d6f3 HTTP/1.1" 200 None 2026-03-05 01:03:47,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:47,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:47,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:47,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5f4911a9cbe7f77d6f3 HTTP/1.1" 200 None 2026-03-05 01:03:47,151 - lava_callback - INFO - Completed processing callback for node 69a8d5f4911a9cbe7f77d6f3 2026-03-05 01:03:50,676 - lava_callback - INFO - Received callback for node 69a8d5f0911a9cbe7f77d6eb INFO: 172.21.0.1:53158 - "POST /node/69a8d5f0911a9cbe7f77d6eb HTTP/1.0" 202 Accepted 2026-03-05 01:03:50,685 - lava_callback - INFO - Starting async job submit for node 69a8d5f0911a9cbe7f77d6eb 2026-03-05 01:03:50,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:50,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f0911a9cbe7f77d6eb HTTP/1.1" 200 None 2026-03-05 01:03:50,729 - lava_callback - DEBUG - Processing node 69a8d5f0911a9cbe7f77d6eb: baseline-arm64-broonie 2026-03-05 01:03:50,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:51,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:51,125 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5f0911a9cbe7f77d6eb/log.txt.gz 2026-03-05 01:03:51,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:51,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:51,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5f0911a9cbe7f77d6eb/lava-logs.yaml 2026-03-05 01:03:51,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:03:51,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:03:51,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5f0911a9cbe7f77d6eb/lava_callback.json.gz 2026-03-05 01:03:51,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:51,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f0911a9cbe7f77d6eb HTTP/1.1" 200 None 2026-03-05 01:03:51,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:51,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:03:51,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:51,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5f0911a9cbe7f77d6eb HTTP/1.1" 200 None 2026-03-05 01:03:51,752 - lava_callback - INFO - Completed processing callback for node 69a8d5f0911a9cbe7f77d6eb 2026-03-05 01:03:52,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:03:52,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:04:02,841 - lava_callback - INFO - Received callback for node 69a8d650911a9cbe7f77d7e8 INFO: 172.21.0.1:43036 - "POST /node/69a8d650911a9cbe7f77d7e8 HTTP/1.0" 202 Accepted 2026-03-05 01:04:02,890 - lava_callback - INFO - Starting async job submit for node 69a8d650911a9cbe7f77d7e8 2026-03-05 01:04:02,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:02,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d650911a9cbe7f77d7e8 HTTP/1.1" 200 None 2026-03-05 01:04:02,940 - lava_callback - DEBUG - Processing node 69a8d650911a9cbe7f77d7e8: baseline-arm 2026-03-05 01:04:03,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:03,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:03,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d650911a9cbe7f77d7e8/log.txt.gz 2026-03-05 01:04:03,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:03,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:03,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d650911a9cbe7f77d7e8/lava-logs.yaml 2026-03-05 01:04:03,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:03,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:03,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d650911a9cbe7f77d7e8/lava_callback.json.gz 2026-03-05 01:04:03,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:03,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d650911a9cbe7f77d7e8 HTTP/1.1" 200 None 2026-03-05 01:04:03,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:03,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:04:03,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:03,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d650911a9cbe7f77d7e8 HTTP/1.1" 200 None 2026-03-05 01:04:03,781 - lava_callback - INFO - Completed processing callback for node 69a8d650911a9cbe7f77d7e8 INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:04:17,593 - lava_callback - INFO - Received callback for node 69a633847da105ad098361ac INFO: 172.21.0.1:48846 - "POST /node/69a633847da105ad098361ac HTTP/1.0" 202 Accepted 2026-03-05 01:04:17,602 - lava_callback - INFO - Starting async job submit for node 69a633847da105ad098361ac 2026-03-05 01:04:17,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:17,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a633847da105ad098361ac HTTP/1.1" 200 None 2026-03-05 01:04:17,617 - lava_callback - DEBUG - Processing node 69a633847da105ad098361ac: baseline-arm-baylibre 2026-03-05 01:04:17,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a633847da105ad098361ac 2026-03-05 01:04:17,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:17,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a633847da105ad098361ac HTTP/1.1" 200 None 2026-03-05 01:04:17,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:17,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 01:04:17,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:17,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a633847da105ad098361ac HTTP/1.1" 200 None 2026-03-05 01:04:17,693 - lava_callback - ERROR - Error processing callback for node 69a633847da105ad098361ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:04:22,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:22,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 01:04:25,498 - lava_callback - INFO - Received callback for node 69a8d67e911a9cbe7f77d8e3 INFO: 172.21.0.1:60838 - "POST /node/69a8d67e911a9cbe7f77d8e3 HTTP/1.0" 202 Accepted 2026-03-05 01:04:25,505 - lava_callback - INFO - Starting async job submit for node 69a8d67e911a9cbe7f77d8e3 2026-03-05 01:04:25,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:25,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d67e911a9cbe7f77d8e3 HTTP/1.1" 200 None 2026-03-05 01:04:25,522 - lava_callback - DEBUG - Processing node 69a8d67e911a9cbe7f77d8e3: baseline-nfs-arm64 2026-03-05 01:04:25,523 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:04:25,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:25,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:25,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d67e911a9cbe7f77d8e3/lava-logs.yaml 2026-03-05 01:04:25,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:25,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:25,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d67e911a9cbe7f77d8e3/lava_callback.json.gz 2026-03-05 01:04:25,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:25,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d67e911a9cbe7f77d8e3 HTTP/1.1" 200 None 2026-03-05 01:04:25,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:25,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:04:25,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:25,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d67e911a9cbe7f77d8e3 HTTP/1.1" 200 None 2026-03-05 01:04:25,818 - lava_callback - INFO - Completed processing callback for node 69a8d67e911a9cbe7f77d8e3 INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:04:33,470 - lava_callback - INFO - Received callback for node 69a8d5af911a9cbe7f77d615 INFO: 172.21.0.1:35284 - "POST /node/69a8d5af911a9cbe7f77d615 HTTP/1.0" 202 Accepted 2026-03-05 01:04:33,476 - lava_callback - INFO - Starting async job submit for node 69a8d5af911a9cbe7f77d615 2026-03-05 01:04:33,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:33,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5af911a9cbe7f77d615 HTTP/1.1" 200 None 2026-03-05 01:04:33,512 - lava_callback - DEBUG - Processing node 69a8d5af911a9cbe7f77d615: baseline-arm64 2026-03-05 01:04:33,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:34,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:34,085 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5af911a9cbe7f77d615/log.txt.gz 2026-03-05 01:04:34,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:34,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:34,509 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5af911a9cbe7f77d615/lava-logs.yaml 2026-03-05 01:04:34,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:34,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:34,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5af911a9cbe7f77d615/lava_callback.json.gz 2026-03-05 01:04:34,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:34,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5af911a9cbe7f77d615 HTTP/1.1" 200 None 2026-03-05 01:04:34,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:34,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:04:34,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:34,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5af911a9cbe7f77d615 HTTP/1.1" 200 None 2026-03-05 01:04:34,821 - lava_callback - INFO - Completed processing callback for node 69a8d5af911a9cbe7f77d615 INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:04:36,577 - lava_callback - INFO - Received callback for node 69a8d64c911a9cbe7f77d7d2 INFO: 172.21.0.1:35302 - "POST /node/69a8d64c911a9cbe7f77d7d2 HTTP/1.0" 202 Accepted 2026-03-05 01:04:36,583 - lava_callback - INFO - Starting async job submit for node 69a8d64c911a9cbe7f77d7d2 2026-03-05 01:04:36,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:36,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64c911a9cbe7f77d7d2 HTTP/1.1" 200 None 2026-03-05 01:04:36,622 - lava_callback - DEBUG - Processing node 69a8d64c911a9cbe7f77d7d2: baseline-arm 2026-03-05 01:04:36,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:36,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:36,946 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64c911a9cbe7f77d7d2/log.txt.gz 2026-03-05 01:04:37,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:37,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:37,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64c911a9cbe7f77d7d2/lava-logs.yaml 2026-03-05 01:04:37,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:37,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:37,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64c911a9cbe7f77d7d2/lava_callback.json.gz 2026-03-05 01:04:37,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:37,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64c911a9cbe7f77d7d2 HTTP/1.1" 200 None 2026-03-05 01:04:37,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:37,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:04:37,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:37,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d64c911a9cbe7f77d7d2 HTTP/1.1" 200 None 2026-03-05 01:04:37,465 - lava_callback - INFO - Completed processing callback for node 69a8d64c911a9cbe7f77d7d2 2026-03-05 01:04:43,405 - lava_callback - INFO - Received callback for node 69a8d670911a9cbe7f77d8bc INFO: 172.21.0.1:48302 - "POST /node/69a8d670911a9cbe7f77d8bc HTTP/1.0" 202 Accepted 2026-03-05 01:04:43,453 - lava_callback - INFO - Starting async job submit for node 69a8d670911a9cbe7f77d8bc 2026-03-05 01:04:43,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:43,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d670911a9cbe7f77d8bc HTTP/1.1" 200 None 2026-03-05 01:04:43,488 - lava_callback - DEBUG - Processing node 69a8d670911a9cbe7f77d8bc: baseline-arm-pengutronix 2026-03-05 01:04:43,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:43,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:43,711 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d670911a9cbe7f77d8bc/log.txt.gz 2026-03-05 01:04:43,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:43,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:43,965 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d670911a9cbe7f77d8bc/lava-logs.yaml 2026-03-05 01:04:43,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:44,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:44,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d670911a9cbe7f77d8bc/lava_callback.json.gz 2026-03-05 01:04:44,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:44,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d670911a9cbe7f77d8bc HTTP/1.1" 200 None 2026-03-05 01:04:44,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:44,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:04:44,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:44,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d670911a9cbe7f77d8bc HTTP/1.1" 200 None 2026-03-05 01:04:44,252 - lava_callback - INFO - Completed processing callback for node 69a8d670911a9cbe7f77d8bc INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:04:47,344 - lava_callback - INFO - Received callback for node 69a8d66c911a9cbe7f77d8af INFO: 172.21.0.1:48320 - "POST /node/69a8d66c911a9cbe7f77d8af HTTP/1.0" 202 Accepted 2026-03-05 01:04:47,353 - lava_callback - INFO - Starting async job submit for node 69a8d66c911a9cbe7f77d8af 2026-03-05 01:04:47,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:47,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d66c911a9cbe7f77d8af HTTP/1.1" 200 None 2026-03-05 01:04:47,387 - lava_callback - DEBUG - Processing node 69a8d66c911a9cbe7f77d8af: baseline-arm-pengutronix 2026-03-05 01:04:47,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:47,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:47,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66c911a9cbe7f77d8af/log.txt.gz 2026-03-05 01:04:47,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:47,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:47,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66c911a9cbe7f77d8af/lava-logs.yaml 2026-03-05 01:04:47,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:48,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:48,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66c911a9cbe7f77d8af/lava_callback.json.gz 2026-03-05 01:04:48,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:48,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d66c911a9cbe7f77d8af HTTP/1.1" 200 None 2026-03-05 01:04:48,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:48,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:04:48,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:48,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d66c911a9cbe7f77d8af HTTP/1.1" 200 None 2026-03-05 01:04:48,227 - lava_callback - INFO - Completed processing callback for node 69a8d66c911a9cbe7f77d8af 2026-03-05 01:04:49,746 - lava_callback - INFO - Received callback for node 69a8d658911a9cbe7f77d811 INFO: 172.21.0.1:51710 - "POST /node/69a8d658911a9cbe7f77d811 HTTP/1.0" 202 Accepted 2026-03-05 01:04:49,752 - lava_callback - INFO - Starting async job submit for node 69a8d658911a9cbe7f77d811 2026-03-05 01:04:49,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:49,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d658911a9cbe7f77d811 HTTP/1.1" 200 None 2026-03-05 01:04:49,797 - lava_callback - DEBUG - Processing node 69a8d658911a9cbe7f77d811: baseline-arm-broonie 2026-03-05 01:04:49,866 - lava_callback - INFO - Received callback for node 69a8d66e911a9cbe7f77d8b2 INFO: 172.21.0.1:51720 - "POST /node/69a8d66e911a9cbe7f77d8b2 HTTP/1.0" 202 Accepted 2026-03-05 01:04:49,882 - lava_callback - INFO - Starting async job submit for node 69a8d66e911a9cbe7f77d8b2 2026-03-05 01:04:49,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:49,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d66e911a9cbe7f77d8b2 HTTP/1.1" 200 None 2026-03-05 01:04:50,001 - lava_callback - DEBUG - Processing node 69a8d66e911a9cbe7f77d8b2: baseline-arm-pengutronix 2026-03-05 01:04:50,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:50,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:50,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:50,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66e911a9cbe7f77d8b2/log.txt.gz 2026-03-05 01:04:50,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:50,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69a8d658911a9cbe7f77d811/log.txt.gz 2026-03-05 01:04:50,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:50,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:50,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:50,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66e911a9cbe7f77d8b2/lava-logs.yaml 2026-03-05 01:04:50,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:50,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:50,866 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69a8d658911a9cbe7f77d811/lava-logs.yaml 2026-03-05 01:04:50,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:51,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:51,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69a8d658911a9cbe7f77d811/lava_callback.json.gz 2026-03-05 01:04:51,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:51,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66e911a9cbe7f77d8b2/lava_callback.json.gz 2026-03-05 01:04:51,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:51,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:51,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d658911a9cbe7f77d811 HTTP/1.1" 200 None 2026-03-05 01:04:51,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:51,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d66e911a9cbe7f77d8b2 HTTP/1.1" 200 None 2026-03-05 01:04:51,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:51,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:04:51,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:51,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:04:51,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:51,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d66e911a9cbe7f77d8b2 HTTP/1.1" 200 None 2026-03-05 01:04:51,252 - lava_callback - INFO - Completed processing callback for node 69a8d66e911a9cbe7f77d8b2 2026-03-05 01:04:51,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d658911a9cbe7f77d811 HTTP/1.1" 200 None 2026-03-05 01:04:51,289 - lava_callback - INFO - Completed processing callback for node 69a8d658911a9cbe7f77d811 2026-03-05 01:04:52,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:52,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-05 01:04:53,893 - lava_callback - INFO - Received callback for node 69a8d64f911a9cbe7f77d7e5 INFO: 172.21.0.1:51732 - "POST /node/69a8d64f911a9cbe7f77d7e5 HTTP/1.0" 202 Accepted 2026-03-05 01:04:53,904 - lava_callback - INFO - Starting async job submit for node 69a8d64f911a9cbe7f77d7e5 2026-03-05 01:04:53,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:53,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64f911a9cbe7f77d7e5 HTTP/1.1" 200 None 2026-03-05 01:04:53,952 - lava_callback - DEBUG - Processing node 69a8d64f911a9cbe7f77d7e5: baseline-arm 2026-03-05 01:04:54,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:54,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:54,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64f911a9cbe7f77d7e5/log.txt.gz 2026-03-05 01:04:54,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:54,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:54,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64f911a9cbe7f77d7e5/lava-logs.yaml 2026-03-05 01:04:54,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:54,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:54,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64f911a9cbe7f77d7e5/lava_callback.json.gz 2026-03-05 01:04:54,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:54,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64f911a9cbe7f77d7e5 HTTP/1.1" 200 None 2026-03-05 01:04:54,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:54,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:04:54,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:54,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d64f911a9cbe7f77d7e5 HTTP/1.1" 200 None 2026-03-05 01:04:54,882 - lava_callback - INFO - Completed processing callback for node 69a8d64f911a9cbe7f77d7e5 INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:04:59,115 - lava_callback - INFO - Received callback for node 69a8d664911a9cbe7f77d88d INFO: 172.21.0.1:51748 - "POST /node/69a8d664911a9cbe7f77d88d HTTP/1.0" 202 Accepted 2026-03-05 01:04:59,121 - lava_callback - INFO - Starting async job submit for node 69a8d664911a9cbe7f77d88d 2026-03-05 01:04:59,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:04:59,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d664911a9cbe7f77d88d HTTP/1.1" 200 None 2026-03-05 01:04:59,158 - lava_callback - DEBUG - Processing node 69a8d664911a9cbe7f77d88d: baseline-arm-clabbe 2026-03-05 01:04:59,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:59,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:59,583 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d664911a9cbe7f77d88d/log.txt.gz 2026-03-05 01:04:59,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:04:59,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:04:59,965 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d664911a9cbe7f77d88d/lava-logs.yaml 2026-03-05 01:04:59,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:00,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:00,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d664911a9cbe7f77d88d/lava_callback.json.gz 2026-03-05 01:05:00,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:00,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d664911a9cbe7f77d88d HTTP/1.1" 200 None 2026-03-05 01:05:00,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:00,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:05:00,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:00,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d664911a9cbe7f77d88d HTTP/1.1" 200 None 2026-03-05 01:05:00,241 - lava_callback - INFO - Completed processing callback for node 69a8d664911a9cbe7f77d88d INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:05:10,131 - lava_callback - INFO - Received callback for node 69a8d65a911a9cbe7f77d818 INFO: 172.21.0.1:56060 - "POST /node/69a8d65a911a9cbe7f77d818 HTTP/1.0" 202 Accepted 2026-03-05 01:05:10,138 - lava_callback - INFO - Starting async job submit for node 69a8d65a911a9cbe7f77d818 2026-03-05 01:05:10,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:10,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d65a911a9cbe7f77d818 HTTP/1.1" 200 None 2026-03-05 01:05:10,198 - lava_callback - DEBUG - Processing node 69a8d65a911a9cbe7f77d818: baseline-arm-broonie 2026-03-05 01:05:10,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:10,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:10,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69a8d65a911a9cbe7f77d818/log.txt.gz 2026-03-05 01:05:10,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:10,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:10,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69a8d65a911a9cbe7f77d818/lava-logs.yaml 2026-03-05 01:05:10,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:10,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:10,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69a8d65a911a9cbe7f77d818/lava_callback.json.gz 2026-03-05 01:05:11,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:11,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d65a911a9cbe7f77d818 HTTP/1.1" 200 None 2026-03-05 01:05:11,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:11,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:05:11,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:11,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d65a911a9cbe7f77d818 HTTP/1.1" 200 None 2026-03-05 01:05:11,076 - lava_callback - INFO - Completed processing callback for node 69a8d65a911a9cbe7f77d818 2026-03-05 01:05:13,747 - lava_callback - INFO - Received callback for node 69a8d66a911a9cbe7f77d89f INFO: 172.21.0.1:56066 - "POST /node/69a8d66a911a9cbe7f77d89f HTTP/1.0" 202 Accepted 2026-03-05 01:05:13,753 - lava_callback - INFO - Starting async job submit for node 69a8d66a911a9cbe7f77d89f 2026-03-05 01:05:13,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:13,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d66a911a9cbe7f77d89f HTTP/1.1" 200 None 2026-03-05 01:05:13,790 - lava_callback - DEBUG - Processing node 69a8d66a911a9cbe7f77d89f: baseline-arm-kontron 2026-03-05 01:05:13,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:14,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:14,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69a8d66a911a9cbe7f77d89f/log.txt.gz 2026-03-05 01:05:14,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:05:14,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:14,360 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69a8d66a911a9cbe7f77d89f/lava-logs.yaml 2026-03-05 01:05:14,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:14,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:14,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69a8d66a911a9cbe7f77d89f/lava_callback.json.gz 2026-03-05 01:05:14,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:14,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d66a911a9cbe7f77d89f HTTP/1.1" 200 None 2026-03-05 01:05:14,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:14,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:05:14,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:14,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d66a911a9cbe7f77d89f HTTP/1.1" 200 None 2026-03-05 01:05:14,579 - lava_callback - INFO - Completed processing callback for node 69a8d66a911a9cbe7f77d89f INFO: 172.21.0.1:56088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:05:22,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:22,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:05:29,713 - lava_callback - INFO - Received callback for node 69a8d5ea911a9cbe7f77d6e2 INFO: 172.21.0.1:57224 - "POST /node/69a8d5ea911a9cbe7f77d6e2 HTTP/1.0" 202 Accepted 2026-03-05 01:05:29,719 - lava_callback - INFO - Starting async job submit for node 69a8d5ea911a9cbe7f77d6e2 2026-03-05 01:05:29,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:29,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ea911a9cbe7f77d6e2 HTTP/1.1" 200 None 2026-03-05 01:05:29,781 - lava_callback - DEBUG - Processing node 69a8d5ea911a9cbe7f77d6e2: baseline-arm64-broonie 2026-03-05 01:05:30,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:30,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:30,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5ea911a9cbe7f77d6e2/log.txt.gz 2026-03-05 01:05:30,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:30,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:30,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5ea911a9cbe7f77d6e2/lava-logs.yaml 2026-03-05 01:05:30,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:30,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:30,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5ea911a9cbe7f77d6e2/lava_callback.json.gz 2026-03-05 01:05:30,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:30,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5ea911a9cbe7f77d6e2 HTTP/1.1" 200 None 2026-03-05 01:05:30,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:30,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:05:30,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:30,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5ea911a9cbe7f77d6e2 HTTP/1.1" 200 None 2026-03-05 01:05:30,866 - lava_callback - INFO - Completed processing callback for node 69a8d5ea911a9cbe7f77d6e2 2026-03-05 01:05:30,954 - lava_callback - INFO - Received callback for node 69a8d5f9911a9cbe7f77d704 INFO: 172.21.0.1:57236 - "POST /node/69a8d5f9911a9cbe7f77d704 HTTP/1.0" 202 Accepted 2026-03-05 01:05:30,963 - lava_callback - INFO - Starting async job submit for node 69a8d5f9911a9cbe7f77d704 2026-03-05 01:05:30,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:31,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f9911a9cbe7f77d704 HTTP/1.1" 200 None 2026-03-05 01:05:31,026 - lava_callback - DEBUG - Processing node 69a8d5f9911a9cbe7f77d704: baseline-arm64-clabbe 2026-03-05 01:05:31,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:31,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:31,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f9911a9cbe7f77d704/log.txt.gz 2026-03-05 01:05:31,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:31,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:31,810 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f9911a9cbe7f77d704/lava-logs.yaml 2026-03-05 01:05:31,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:31,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:31,947 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f9911a9cbe7f77d704/lava_callback.json.gz 2026-03-05 01:05:31,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:31,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f9911a9cbe7f77d704 HTTP/1.1" 200 None 2026-03-05 01:05:31,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:31,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:05:32,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:32,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5f9911a9cbe7f77d704 HTTP/1.1" 200 None 2026-03-05 01:05:32,027 - lava_callback - INFO - Completed processing callback for node 69a8d5f9911a9cbe7f77d704 2026-03-05 01:05:34,281 - lava_callback - INFO - Received callback for node 69a8d663911a9cbe7f77d885 INFO: 172.21.0.1:57238 - "POST /node/69a8d663911a9cbe7f77d885 HTTP/1.0" 202 Accepted 2026-03-05 01:05:34,287 - lava_callback - INFO - Starting async job submit for node 69a8d663911a9cbe7f77d885 2026-03-05 01:05:34,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:34,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d663911a9cbe7f77d885 HTTP/1.1" 200 None 2026-03-05 01:05:34,326 - lava_callback - DEBUG - Processing node 69a8d663911a9cbe7f77d885: baseline-arm-clabbe 2026-03-05 01:05:34,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:34,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:34,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d663911a9cbe7f77d885/log.txt.gz 2026-03-05 01:05:34,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:34,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:34,981 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d663911a9cbe7f77d885/lava-logs.yaml 2026-03-05 01:05:34,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:35,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:35,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d663911a9cbe7f77d885/lava_callback.json.gz 2026-03-05 01:05:35,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:35,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d663911a9cbe7f77d885 HTTP/1.1" 200 None 2026-03-05 01:05:35,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:35,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:05:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:35,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d663911a9cbe7f77d885 HTTP/1.1" 200 None 2026-03-05 01:05:35,194 - lava_callback - INFO - Completed processing callback for node 69a8d663911a9cbe7f77d885 2026-03-05 01:05:35,516 - lava_callback - INFO - Received callback for node 69a8d5f6911a9cbe7f77d6fb INFO: 172.21.0.1:57240 - "POST /node/69a8d5f6911a9cbe7f77d6fb HTTP/1.0" 202 Accepted 2026-03-05 01:05:35,523 - lava_callback - INFO - Starting async job submit for node 69a8d5f6911a9cbe7f77d6fb 2026-03-05 01:05:35,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:35,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f6911a9cbe7f77d6fb HTTP/1.1" 200 None 2026-03-05 01:05:35,567 - lava_callback - DEBUG - Processing node 69a8d5f6911a9cbe7f77d6fb: baseline-arm64-clabbe 2026-03-05 01:05:35,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:36,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:36,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f6911a9cbe7f77d6fb/log.txt.gz 2026-03-05 01:05:36,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:36,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:36,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f6911a9cbe7f77d6fb/lava-logs.yaml 2026-03-05 01:05:36,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:05:36,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:36,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f6911a9cbe7f77d6fb/lava_callback.json.gz 2026-03-05 01:05:36,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:36,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f6911a9cbe7f77d6fb HTTP/1.1" 200 None 2026-03-05 01:05:36,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:36,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:05:36,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:36,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5f6911a9cbe7f77d6fb HTTP/1.1" 200 None 2026-03-05 01:05:36,700 - lava_callback - INFO - Completed processing callback for node 69a8d5f6911a9cbe7f77d6fb 2026-03-05 01:05:40,832 - lava_callback - INFO - Received callback for node 69a8d5c6911a9cbe7f77d649 INFO: 172.21.0.1:56050 - "POST /node/69a8d5c6911a9cbe7f77d649 HTTP/1.0" 202 Accepted 2026-03-05 01:05:40,838 - lava_callback - INFO - Starting async job submit for node 69a8d5c6911a9cbe7f77d649 2026-03-05 01:05:40,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:40,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c6911a9cbe7f77d649 HTTP/1.1" 200 None 2026-03-05 01:05:40,873 - lava_callback - DEBUG - Processing node 69a8d5c6911a9cbe7f77d649: baseline-nfs-arm64 2026-03-05 01:05:41,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:41,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:41,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c6911a9cbe7f77d649/log.txt.gz 2026-03-05 01:05:41,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:41,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:41,878 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c6911a9cbe7f77d649/lava-logs.yaml 2026-03-05 01:05:41,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:42,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:42,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c6911a9cbe7f77d649/lava_callback.json.gz 2026-03-05 01:05:42,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:42,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c6911a9cbe7f77d649 HTTP/1.1" 200 None 2026-03-05 01:05:42,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:42,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:05:42,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:42,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5c6911a9cbe7f77d649 HTTP/1.1" 200 None 2026-03-05 01:05:42,140 - lava_callback - INFO - Completed processing callback for node 69a8d5c6911a9cbe7f77d649 INFO: 172.21.0.1:56064 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:05:52,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:52,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-05 01:05:52,966 - lava_callback - INFO - Received callback for node 69a8d5f7911a9cbe7f77d6fe INFO: 172.21.0.1:60264 - "POST /node/69a8d5f7911a9cbe7f77d6fe HTTP/1.0" 202 Accepted 2026-03-05 01:05:52,972 - lava_callback - INFO - Starting async job submit for node 69a8d5f7911a9cbe7f77d6fe 2026-03-05 01:05:52,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:53,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f7911a9cbe7f77d6fe HTTP/1.1" 200 None 2026-03-05 01:05:53,011 - lava_callback - DEBUG - Processing node 69a8d5f7911a9cbe7f77d6fe: baseline-arm64-clabbe 2026-03-05 01:05:53,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:53,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:53,342 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f7911a9cbe7f77d6fe/log.txt.gz 2026-03-05 01:05:53,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:53,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:53,648 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f7911a9cbe7f77d6fe/lava-logs.yaml 2026-03-05 01:05:53,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:05:53,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:05:53,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69a8d5f7911a9cbe7f77d6fe/lava_callback.json.gz 2026-03-05 01:05:53,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:53,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f7911a9cbe7f77d6fe HTTP/1.1" 200 None 2026-03-05 01:05:53,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:53,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:05:53,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:53,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5f7911a9cbe7f77d6fe HTTP/1.1" 200 None 2026-03-05 01:05:53,920 - lava_callback - INFO - Completed processing callback for node 69a8d5f7911a9cbe7f77d6fe INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:05:57,701 - lava_callback - INFO - Received callback for node 69a633e67da105ad09836228 INFO: 172.21.0.1:60268 - "POST /node/69a633e67da105ad09836228 HTTP/1.0" 202 Accepted 2026-03-05 01:05:57,706 - lava_callback - INFO - Starting async job submit for node 69a633e67da105ad09836228 2026-03-05 01:05:57,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:57,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a633e67da105ad09836228 HTTP/1.1" 200 None 2026-03-05 01:05:57,722 - lava_callback - DEBUG - Processing node 69a633e67da105ad09836228: baseline-arm-baylibre 2026-03-05 01:05:57,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a633e67da105ad09836228 2026-03-05 01:05:57,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:57,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a633e67da105ad09836228 HTTP/1.1" 200 None 2026-03-05 01:05:57,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:57,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 01:05:57,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:05:57,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a633e67da105ad09836228 HTTP/1.1" 200 None 2026-03-05 01:05:57,778 - lava_callback - ERROR - Error processing callback for node 69a633e67da105ad09836228: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:06:09,986 - lava_callback - INFO - Received callback for node 69a86460440c1da21c237cc8 INFO: 172.21.0.1:51102 - "POST /node/69a86460440c1da21c237cc8 HTTP/1.0" 202 Accepted 2026-03-05 01:06:09,996 - lava_callback - INFO - Starting async job submit for node 69a86460440c1da21c237cc8 2026-03-05 01:06:10,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:10,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86460440c1da21c237cc8 HTTP/1.1" 200 None 2026-03-05 01:06:10,055 - lava_callback - DEBUG - Processing node 69a86460440c1da21c237cc8: baseline-arm64-broonie 2026-03-05 01:06:10,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:10,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:10,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a86460440c1da21c237cc8/log.txt.gz 2026-03-05 01:06:10,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:10,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:10,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a86460440c1da21c237cc8/lava-logs.yaml 2026-03-05 01:06:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:10,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:10,926 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a86460440c1da21c237cc8/lava_callback.json.gz 2026-03-05 01:06:10,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:10,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a86460440c1da21c237cc8 HTTP/1.1" 200 None 2026-03-05 01:06:10,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:11,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-05 01:06:11,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:11,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a86460440c1da21c237cc8 HTTP/1.1" 200 None 2026-03-05 01:06:11,051 - lava_callback - INFO - Completed processing callback for node 69a86460440c1da21c237cc8 INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:06:22,239 - lava_callback - INFO - Received callback for node 69a8d68c911a9cbe7f77d913 INFO: 172.21.0.1:52074 - "POST /node/69a8d68c911a9cbe7f77d913 HTTP/1.0" 202 Accepted 2026-03-05 01:06:22,245 - lava_callback - INFO - Starting async job submit for node 69a8d68c911a9cbe7f77d913 2026-03-05 01:06:22,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:22,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d68c911a9cbe7f77d913 HTTP/1.1" 200 None 2026-03-05 01:06:22,284 - lava_callback - DEBUG - Processing node 69a8d68c911a9cbe7f77d913: ltp-dio 2026-03-05 01:06:22,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:22,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:22,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 01:06:22,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:22,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69a8d68c911a9cbe7f77d913/log.txt.gz 2026-03-05 01:06:23,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:23,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:23,221 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69a8d68c911a9cbe7f77d913/lava-logs.yaml 2026-03-05 01:06:23,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:23,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:23,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69a8d68c911a9cbe7f77d913/lava_callback.json.gz 2026-03-05 01:06:23,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:23,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d68c911a9cbe7f77d913 HTTP/1.1" 200 None 2026-03-05 01:06:23,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:23,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:06:23,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:23,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d68c911a9cbe7f77d913 HTTP/1.1" 200 None 2026-03-05 01:06:23,465 - lava_callback - INFO - Completed processing callback for node 69a8d68c911a9cbe7f77d913 INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:06:49,508 - lava_callback - INFO - Received callback for node 69a8ba78440c1da21c239cdf INFO: 172.21.0.1:40562 - "POST /node/69a8ba78440c1da21c239cdf HTTP/1.0" 202 Accepted 2026-03-05 01:06:49,514 - lava_callback - INFO - Starting async job submit for node 69a8ba78440c1da21c239cdf 2026-03-05 01:06:49,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:49,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ba78440c1da21c239cdf HTTP/1.1" 200 None 2026-03-05 01:06:49,551 - lava_callback - DEBUG - Processing node 69a8ba78440c1da21c239cdf: baseline-arm64-broonie 2026-03-05 01:06:49,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:49,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:49,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8ba78440c1da21c239cdf/log.txt.gz 2026-03-05 01:06:50,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:50,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:50,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8ba78440c1da21c239cdf/lava-logs.yaml 2026-03-05 01:06:50,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:50,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:50,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8ba78440c1da21c239cdf/lava_callback.json.gz 2026-03-05 01:06:50,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:50,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ba78440c1da21c239cdf HTTP/1.1" 200 None 2026-03-05 01:06:50,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:50,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-05 01:06:50,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:50,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ba78440c1da21c239cdf HTTP/1.1" 200 None 2026-03-05 01:06:50,562 - lava_callback - INFO - Completed processing callback for node 69a8ba78440c1da21c239cdf 2026-03-05 01:06:52,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:52,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:06:59,135 - lava_callback - INFO - Received callback for node 69a8d725911a9cbe7f77da1e INFO: 172.21.0.1:58308 - "POST /node/69a8d725911a9cbe7f77da1e HTTP/1.0" 202 Accepted 2026-03-05 01:06:59,141 - lava_callback - INFO - Starting async job submit for node 69a8d725911a9cbe7f77da1e 2026-03-05 01:06:59,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:59,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d725911a9cbe7f77da1e HTTP/1.1" 200 None 2026-03-05 01:06:59,159 - lava_callback - DEBUG - Processing node 69a8d725911a9cbe7f77da1e: baseline-nfs-arm64 2026-03-05 01:06:59,161 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:06:59,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:59,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:59,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d725911a9cbe7f77da1e/lava-logs.yaml 2026-03-05 01:06:59,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:06:59,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:06:59,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d725911a9cbe7f77da1e/lava_callback.json.gz 2026-03-05 01:06:59,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:59,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d725911a9cbe7f77da1e HTTP/1.1" 200 None 2026-03-05 01:06:59,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:59,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:06:59,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:06:59,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d725911a9cbe7f77da1e HTTP/1.1" 200 None 2026-03-05 01:06:59,526 - lava_callback - INFO - Completed processing callback for node 69a8d725911a9cbe7f77da1e INFO: 172.21.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:07:22,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:07:22,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:07:36,057 - lava_callback - INFO - Received callback for node 69a8d65f911a9cbe7f77d84b INFO: 172.21.0.1:36586 - "POST /node/69a8d65f911a9cbe7f77d84b HTTP/1.0" 202 Accepted 2026-03-05 01:07:36,063 - lava_callback - INFO - Starting async job submit for node 69a8d65f911a9cbe7f77d84b 2026-03-05 01:07:36,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:07:36,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d65f911a9cbe7f77d84b HTTP/1.1" 200 None 2026-03-05 01:07:36,107 - lava_callback - DEBUG - Processing node 69a8d65f911a9cbe7f77d84b: baseline-arm-clabbe 2026-03-05 01:07:36,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:07:36,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:07:36,521 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d65f911a9cbe7f77d84b/log.txt.gz 2026-03-05 01:07:36,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:07:36,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:07:36,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d65f911a9cbe7f77d84b/lava-logs.yaml 2026-03-05 01:07:36,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:07:37,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:07:37,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d65f911a9cbe7f77d84b/lava_callback.json.gz 2026-03-05 01:07:37,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:07:37,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d65f911a9cbe7f77d84b HTTP/1.1" 200 None 2026-03-05 01:07:37,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:07:37,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:07:37,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:07:37,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d65f911a9cbe7f77d84b HTTP/1.1" 200 None 2026-03-05 01:07:37,170 - lava_callback - INFO - Completed processing callback for node 69a8d65f911a9cbe7f77d84b INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:07:52,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:07:52,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:07:57,764 - lava_callback - INFO - Received callback for node 69a8d601911a9cbe7f77d71f INFO: 172.21.0.1:48718 - "POST /node/69a8d601911a9cbe7f77d71f HTTP/1.0" 202 Accepted 2026-03-05 01:07:57,776 - lava_callback - INFO - Starting async job submit for node 69a8d601911a9cbe7f77d71f 2026-03-05 01:07:57,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:07:57,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d601911a9cbe7f77d71f HTTP/1.1" 200 None 2026-03-05 01:07:57,848 - lava_callback - DEBUG - Processing node 69a8d601911a9cbe7f77d71f: baseline-arm64-foundriesio 2026-03-05 01:07:59,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:07:59,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:07:59,188 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8d601911a9cbe7f77d71f/log.txt.gz 2026-03-05 01:07:59,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:08:00,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:08:00,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8d601911a9cbe7f77d71f/lava-logs.yaml 2026-03-05 01:08:00,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:08:00,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:08:00,439 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8d601911a9cbe7f77d71f/lava_callback.json.gz DEBUG: Setup failed for 69a8d601911a9cbe7f77d71f. Transitting job node result: incomplete -> fail 2026-03-05 01:08:00,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:00,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d601911a9cbe7f77d71f HTTP/1.1" 200 None 2026-03-05 01:08:00,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:00,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:08:00,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:00,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d601911a9cbe7f77d71f HTTP/1.1" 200 None 2026-03-05 01:08:00,717 - lava_callback - INFO - Completed processing callback for node 69a8d601911a9cbe7f77d71f INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49796 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:08:22,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:22,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:08:49,636 - lava_callback - INFO - Received callback for node 69a8d5e3911a9cbe7f77d6b0 INFO: 172.21.0.1:40766 - "POST /node/69a8d5e3911a9cbe7f77d6b0 HTTP/1.0" 202 Accepted 2026-03-05 01:08:49,642 - lava_callback - INFO - Starting async job submit for node 69a8d5e3911a9cbe7f77d6b0 2026-03-05 01:08:49,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:49,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5e3911a9cbe7f77d6b0 HTTP/1.1" 200 None 2026-03-05 01:08:49,680 - lava_callback - DEBUG - Processing node 69a8d5e3911a9cbe7f77d6b0: baseline-arm64-broonie 2026-03-05 01:08:49,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:08:50,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:08:50,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5e3911a9cbe7f77d6b0/log.txt.gz 2026-03-05 01:08:50,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:08:50,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:08:50,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5e3911a9cbe7f77d6b0/lava-logs.yaml 2026-03-05 01:08:50,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:08:50,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:08:50,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69a8d5e3911a9cbe7f77d6b0/lava_callback.json.gz 2026-03-05 01:08:50,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:50,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5e3911a9cbe7f77d6b0 HTTP/1.1" 200 None 2026-03-05 01:08:50,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:50,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:08:50,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:50,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5e3911a9cbe7f77d6b0 HTTP/1.1" 200 None 2026-03-05 01:08:50,686 - lava_callback - INFO - Completed processing callback for node 69a8d5e3911a9cbe7f77d6b0 2026-03-05 01:08:52,235 - lava_callback - INFO - Received callback for node 69a8d5c0911a9cbe7f77d63d INFO: 172.21.0.1:43818 - "POST /node/69a8d5c0911a9cbe7f77d63d HTTP/1.0" 202 Accepted 2026-03-05 01:08:52,242 - lava_callback - INFO - Starting async job submit for node 69a8d5c0911a9cbe7f77d63d 2026-03-05 01:08:52,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:52,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c0911a9cbe7f77d63d HTTP/1.1" 200 None 2026-03-05 01:08:52,299 - lava_callback - DEBUG - Processing node 69a8d5c0911a9cbe7f77d63d: baseline-arm64 2026-03-05 01:08:52,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:08:52,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:52,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 01:08:52,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:08:52,789 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5c0911a9cbe7f77d63d/log.txt.gz 2026-03-05 01:08:52,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:08:53,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:08:53,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5c0911a9cbe7f77d63d/lava-logs.yaml 2026-03-05 01:08:53,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:08:53,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:08:53,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d5c0911a9cbe7f77d63d/lava_callback.json.gz DEBUG: Setup failed for 69a8d5c0911a9cbe7f77d63d. Transitting job node result: incomplete -> fail 2026-03-05 01:08:53,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:53,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c0911a9cbe7f77d63d HTTP/1.1" 200 None 2026-03-05 01:08:53,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:53,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:08:53,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:08:53,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5c0911a9cbe7f77d63d HTTP/1.1" 200 None 2026-03-05 01:08:53,614 - lava_callback - INFO - Completed processing callback for node 69a8d5c0911a9cbe7f77d63d INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:09:22,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:22,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 01:09:23,082 - lava_callback - INFO - Received callback for node 69a8d660911a9cbe7f77d84f INFO: 172.21.0.1:47292 - "POST /node/69a8d660911a9cbe7f77d84f HTTP/1.0" 202 Accepted 2026-03-05 01:09:23,088 - lava_callback - INFO - Starting async job submit for node 69a8d660911a9cbe7f77d84f 2026-03-05 01:09:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:23,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d660911a9cbe7f77d84f HTTP/1.1" 200 None 2026-03-05 01:09:23,125 - lava_callback - DEBUG - Processing node 69a8d660911a9cbe7f77d84f: baseline-arm-clabbe 2026-03-05 01:09:23,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:09:23,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:09:23,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d660911a9cbe7f77d84f/log.txt.gz 2026-03-05 01:09:23,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:09:23,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:09:23,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d660911a9cbe7f77d84f/lava-logs.yaml 2026-03-05 01:09:23,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:09:24,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:09:24,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d660911a9cbe7f77d84f/lava_callback.json.gz 2026-03-05 01:09:24,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:24,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d660911a9cbe7f77d84f HTTP/1.1" 200 None 2026-03-05 01:09:24,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:24,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:09:24,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:24,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d660911a9cbe7f77d84f HTTP/1.1" 200 None 2026-03-05 01:09:24,225 - lava_callback - INFO - Completed processing callback for node 69a8d660911a9cbe7f77d84f INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:09:37,988 - lava_callback - INFO - Received callback for node 69a634cf7da105ad098362f8 INFO: 172.21.0.1:40176 - "POST /node/69a634cf7da105ad098362f8 HTTP/1.0" 202 Accepted 2026-03-05 01:09:37,994 - lava_callback - INFO - Starting async job submit for node 69a634cf7da105ad098362f8 2026-03-05 01:09:37,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:38,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a634cf7da105ad098362f8 HTTP/1.1" 200 None 2026-03-05 01:09:38,022 - lava_callback - DEBUG - Processing node 69a634cf7da105ad098362f8: baseline-arm64-baylibre 2026-03-05 01:09:38,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a634cf7da105ad098362f8 2026-03-05 01:09:38,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:38,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a634cf7da105ad098362f8 HTTP/1.1" 200 None 2026-03-05 01:09:38,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:38,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 01:09:38,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:38,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a634cf7da105ad098362f8 HTTP/1.1" 200 None 2026-03-05 01:09:38,080 - lava_callback - ERROR - Error processing callback for node 69a634cf7da105ad098362f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:09:52,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:52,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 01:09:53,051 - lava_callback - INFO - Received callback for node 69a8d7d0911a9cbe7f77dacf INFO: 172.21.0.1:48556 - "POST /node/69a8d7d0911a9cbe7f77dacf HTTP/1.0" 202 Accepted 2026-03-05 01:09:53,057 - lava_callback - INFO - Starting async job submit for node 69a8d7d0911a9cbe7f77dacf 2026-03-05 01:09:53,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:53,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d7d0911a9cbe7f77dacf HTTP/1.1" 200 None 2026-03-05 01:09:53,083 - lava_callback - DEBUG - Processing node 69a8d7d0911a9cbe7f77dacf: baseline-nfs-arm64 2026-03-05 01:09:53,084 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:09:53,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:09:53,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:09:53,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d7d0911a9cbe7f77dacf/lava-logs.yaml 2026-03-05 01:09:53,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:09:53,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:09:53,459 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d7d0911a9cbe7f77dacf/lava_callback.json.gz 2026-03-05 01:09:53,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:53,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d7d0911a9cbe7f77dacf HTTP/1.1" 200 None 2026-03-05 01:09:53,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:53,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:09:53,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:09:53,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d7d0911a9cbe7f77dacf HTTP/1.1" 200 None 2026-03-05 01:09:53,537 - lava_callback - INFO - Completed processing callback for node 69a8d7d0911a9cbe7f77dacf INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:10:22,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:10:22,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:11:02,270 - lava_callback - INFO - Received callback for node 69a8d666911a9cbe7f77d896 INFO: 172.21.0.1:51342 - "POST /node/69a8d666911a9cbe7f77d896 HTTP/1.0" 202 Accepted 2026-03-05 01:11:02,276 - lava_callback - INFO - Starting async job submit for node 69a8d666911a9cbe7f77d896 2026-03-05 01:11:02,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:02,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d666911a9cbe7f77d896 HTTP/1.1" 200 None 2026-03-05 01:11:02,312 - lava_callback - DEBUG - Processing node 69a8d666911a9cbe7f77d896: baseline-arm-clabbe 2026-03-05 01:11:02,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:11:02,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:11:02,684 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d666911a9cbe7f77d896/log.txt.gz 2026-03-05 01:11:02,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:11:03,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:11:03,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d666911a9cbe7f77d896/lava-logs.yaml 2026-03-05 01:11:03,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:11:03,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:11:03,153 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d666911a9cbe7f77d896/lava_callback.json.gz 2026-03-05 01:11:03,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:03,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d666911a9cbe7f77d896 HTTP/1.1" 200 None 2026-03-05 01:11:03,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:03,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:11:03,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:03,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d666911a9cbe7f77d896 HTTP/1.1" 200 None 2026-03-05 01:11:03,245 - lava_callback - INFO - Completed processing callback for node 69a8d666911a9cbe7f77d896 INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:11:18,017 - lava_callback - INFO - Received callback for node 69a6352b7da105ad09836316 INFO: 172.21.0.1:39492 - "POST /node/69a6352b7da105ad09836316 HTTP/1.0" 202 Accepted 2026-03-05 01:11:18,023 - lava_callback - INFO - Starting async job submit for node 69a6352b7da105ad09836316 2026-03-05 01:11:18,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:18,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6352b7da105ad09836316 HTTP/1.1" 200 None 2026-03-05 01:11:18,039 - lava_callback - DEBUG - Processing node 69a6352b7da105ad09836316: baseline-arm64-baylibre 2026-03-05 01:11:18,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6352b7da105ad09836316 2026-03-05 01:11:18,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:18,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6352b7da105ad09836316 HTTP/1.1" 200 None 2026-03-05 01:11:18,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:18,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 01:11:18,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:18,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6352b7da105ad09836316 HTTP/1.1" 200 None 2026-03-05 01:11:18,098 - lava_callback - ERROR - Error processing callback for node 69a6352b7da105ad09836316: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:11:22,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:11:22,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:12:10,375 - lava_callback - INFO - Received callback for node 69a8d445911a9cbe7f77d505 INFO: 172.21.0.1:38486 - "POST /node/69a8d445911a9cbe7f77d505 HTTP/1.0" 202 Accepted 2026-03-05 01:12:10,388 - lava_callback - INFO - Starting async job submit for node 69a8d445911a9cbe7f77d505 2026-03-05 01:12:10,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:10,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d445911a9cbe7f77d505 HTTP/1.1" 200 None 2026-03-05 01:12:10,504 - lava_callback - DEBUG - Processing node 69a8d445911a9cbe7f77d505: ltp-smoke 2026-03-05 01:12:11,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:12:11,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:12:11,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8d445911a9cbe7f77d505/log.txt.gz 2026-03-05 01:12:11,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:12:11,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:12:11,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8d445911a9cbe7f77d505/lava-logs.yaml 2026-03-05 01:12:11,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:12:11,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:12:11,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8d445911a9cbe7f77d505/lava_callback.json.gz 2026-03-05 01:12:12,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:12,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d445911a9cbe7f77d505 HTTP/1.1" 200 None 2026-03-05 01:12:12,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:12,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbc3911a9cbe7f77ccb1 HTTP/1.1" 200 None 2026-03-05 01:12:12,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:12,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d445911a9cbe7f77d505 HTTP/1.1" 200 None 2026-03-05 01:12:12,227 - lava_callback - INFO - Completed processing callback for node 69a8d445911a9cbe7f77d505 INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:12:22,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:22,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:12:33,331 - lava_callback - INFO - Received callback for node 69a8d667911a9cbe7f77d899 INFO: 172.21.0.1:57176 - "POST /node/69a8d667911a9cbe7f77d899 HTTP/1.0" 202 Accepted 2026-03-05 01:12:33,337 - lava_callback - INFO - Starting async job submit for node 69a8d667911a9cbe7f77d899 2026-03-05 01:12:33,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:33,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d667911a9cbe7f77d899 HTTP/1.1" 200 None 2026-03-05 01:12:33,375 - lava_callback - DEBUG - Processing node 69a8d667911a9cbe7f77d899: baseline-arm-clabbe 2026-03-05 01:12:33,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:12:33,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:12:33,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d667911a9cbe7f77d899/log.txt.gz 2026-03-05 01:12:33,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:12:34,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:12:34,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d667911a9cbe7f77d899/lava-logs.yaml 2026-03-05 01:12:34,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:12:34,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:12:34,267 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d667911a9cbe7f77d899/lava_callback.json.gz 2026-03-05 01:12:34,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:34,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d667911a9cbe7f77d899 HTTP/1.1" 200 None 2026-03-05 01:12:34,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:34,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:12:34,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:34,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d667911a9cbe7f77d899 HTTP/1.1" 200 None 2026-03-05 01:12:34,346 - lava_callback - INFO - Completed processing callback for node 69a8d667911a9cbe7f77d899 INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:12:52,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:52,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 01:12:53,108 - lava_callback - INFO - Received callback for node 69a635927da105ad0983640b INFO: 172.21.0.1:36116 - "POST /node/69a635927da105ad0983640b HTTP/1.0" 202 Accepted 2026-03-05 01:12:53,113 - lava_callback - INFO - Starting async job submit for node 69a635927da105ad0983640b 2026-03-05 01:12:53,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:53,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635927da105ad0983640b HTTP/1.1" 200 None 2026-03-05 01:12:53,129 - lava_callback - DEBUG - Processing node 69a635927da105ad0983640b: baseline-arm64-broonie 2026-03-05 01:12:53,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a635927da105ad0983640b 2026-03-05 01:12:53,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:53,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635927da105ad0983640b HTTP/1.1" 200 None 2026-03-05 01:12:53,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:53,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 01:12:53,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:53,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a635927da105ad0983640b HTTP/1.1" 200 None 2026-03-05 01:12:53,185 - lava_callback - ERROR - Error processing callback for node 69a635927da105ad0983640b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:12:58,113 - lava_callback - INFO - Received callback for node 69a635857da105ad098363e8 INFO: 172.21.0.1:36134 - "POST /node/69a635857da105ad098363e8 HTTP/1.0" 202 Accepted 2026-03-05 01:12:58,118 - lava_callback - INFO - Starting async job submit for node 69a635857da105ad098363e8 2026-03-05 01:12:58,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:58,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635857da105ad098363e8 HTTP/1.1" 200 None 2026-03-05 01:12:58,135 - lava_callback - DEBUG - Processing node 69a635857da105ad098363e8: baseline-arm64-baylibre 2026-03-05 01:12:58,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a635857da105ad098363e8 2026-03-05 01:12:58,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:58,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635857da105ad098363e8 HTTP/1.1" 200 None 2026-03-05 01:12:58,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:58,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 01:12:58,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:58,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a635857da105ad098363e8 HTTP/1.1" 200 None 2026-03-05 01:12:58,211 - lava_callback - ERROR - Error processing callback for node 69a635857da105ad098363e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:12:58,798 - lava_callback - INFO - Received callback for node 69a635867da105ad098363ec INFO: 172.21.0.1:36150 - "POST /node/69a635867da105ad098363ec HTTP/1.0" 202 Accepted 2026-03-05 01:12:58,804 - lava_callback - INFO - Starting async job submit for node 69a635867da105ad098363ec 2026-03-05 01:12:58,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:58,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635867da105ad098363ec HTTP/1.1" 200 None 2026-03-05 01:12:58,827 - lava_callback - DEBUG - Processing node 69a635867da105ad098363ec: baseline-arm64-baylibre 2026-03-05 01:12:58,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a635867da105ad098363ec 2026-03-05 01:12:58,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:58,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635867da105ad098363ec HTTP/1.1" 200 None 2026-03-05 01:12:58,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:58,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 01:12:58,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:58,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a635867da105ad098363ec HTTP/1.1" 200 None 2026-03-05 01:12:58,880 - lava_callback - ERROR - Error processing callback for node 69a635867da105ad098363ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:12:59,483 - lava_callback - INFO - Received callback for node 69a635877da105ad098363ef INFO: 172.21.0.1:36160 - "POST /node/69a635877da105ad098363ef HTTP/1.0" 202 Accepted 2026-03-05 01:12:59,488 - lava_callback - INFO - Starting async job submit for node 69a635877da105ad098363ef 2026-03-05 01:12:59,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:59,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635877da105ad098363ef HTTP/1.1" 200 None 2026-03-05 01:12:59,509 - lava_callback - DEBUG - Processing node 69a635877da105ad098363ef: baseline-arm64-baylibre 2026-03-05 01:12:59,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a635877da105ad098363ef 2026-03-05 01:12:59,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:59,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635877da105ad098363ef HTTP/1.1" 200 None 2026-03-05 01:12:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:59,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 01:12:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:12:59,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a635877da105ad098363ef HTTP/1.1" 200 None 2026-03-05 01:12:59,568 - lava_callback - ERROR - Error processing callback for node 69a635877da105ad098363ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:13:00,172 - lava_callback - INFO - Received callback for node 69a6358c7da105ad098363fc INFO: 172.21.0.1:33270 - "POST /node/69a6358c7da105ad098363fc HTTP/1.0" 202 Accepted 2026-03-05 01:13:00,177 - lava_callback - INFO - Starting async job submit for node 69a6358c7da105ad098363fc 2026-03-05 01:13:00,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:00,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6358c7da105ad098363fc HTTP/1.1" 200 None 2026-03-05 01:13:00,193 - lava_callback - DEBUG - Processing node 69a6358c7da105ad098363fc: baseline-arm64-baylibre 2026-03-05 01:13:00,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6358c7da105ad098363fc 2026-03-05 01:13:00,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:00,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6358c7da105ad098363fc HTTP/1.1" 200 None 2026-03-05 01:13:00,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:00,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 01:13:00,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:00,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6358c7da105ad098363fc HTTP/1.1" 200 None 2026-03-05 01:13:00,254 - lava_callback - ERROR - Error processing callback for node 69a6358c7da105ad098363fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:13:00,836 - lava_callback - INFO - Received callback for node 69a6358d7da105ad098363ff INFO: 172.21.0.1:33278 - "POST /node/69a6358d7da105ad098363ff HTTP/1.0" 202 Accepted 2026-03-05 01:13:00,842 - lava_callback - INFO - Starting async job submit for node 69a6358d7da105ad098363ff 2026-03-05 01:13:00,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:00,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6358d7da105ad098363ff HTTP/1.1" 200 None 2026-03-05 01:13:00,858 - lava_callback - DEBUG - Processing node 69a6358d7da105ad098363ff: baseline-arm64-baylibre 2026-03-05 01:13:00,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6358d7da105ad098363ff 2026-03-05 01:13:00,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:00,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6358d7da105ad098363ff HTTP/1.1" 200 None 2026-03-05 01:13:00,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:00,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 01:13:00,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:00,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6358d7da105ad098363ff HTTP/1.1" 200 None 2026-03-05 01:13:00,916 - lava_callback - ERROR - Error processing callback for node 69a6358d7da105ad098363ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:13:01,514 - lava_callback - INFO - Received callback for node 69a6358a7da105ad098363f6 INFO: 172.21.0.1:33282 - "POST /node/69a6358a7da105ad098363f6 HTTP/1.0" 202 Accepted 2026-03-05 01:13:01,524 - lava_callback - INFO - Starting async job submit for node 69a6358a7da105ad098363f6 2026-03-05 01:13:01,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:01,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6358a7da105ad098363f6 HTTP/1.1" 200 None 2026-03-05 01:13:01,550 - lava_callback - DEBUG - Processing node 69a6358a7da105ad098363f6: baseline-arm64-baylibre 2026-03-05 01:13:01,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6358a7da105ad098363f6 2026-03-05 01:13:01,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:01,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6358a7da105ad098363f6 HTTP/1.1" 200 None 2026-03-05 01:13:01,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:01,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 01:13:01,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:01,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6358a7da105ad098363f6 HTTP/1.1" 200 None 2026-03-05 01:13:01,656 - lava_callback - ERROR - Error processing callback for node 69a6358a7da105ad098363f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 01:13:02,187 - lava_callback - INFO - Received callback for node 69a6358a7da105ad098363f8 INFO: 172.21.0.1:33290 - "POST /node/69a6358a7da105ad098363f8 HTTP/1.0" 202 Accepted 2026-03-05 01:13:02,194 - lava_callback - INFO - Starting async job submit for node 69a6358a7da105ad098363f8 2026-03-05 01:13:02,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:02,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6358a7da105ad098363f8 HTTP/1.1" 200 None 2026-03-05 01:13:02,218 - lava_callback - DEBUG - Processing node 69a6358a7da105ad098363f8: baseline-arm64-baylibre 2026-03-05 01:13:02,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6358a7da105ad098363f8 2026-03-05 01:13:02,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:02,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6358a7da105ad098363f8 HTTP/1.1" 200 None 2026-03-05 01:13:02,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:02,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 01:13:02,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:13:02,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6358a7da105ad098363f8 HTTP/1.1" 200 None 2026-03-05 01:13:02,280 - lava_callback - ERROR - Error processing callback for node 69a6358a7da105ad098363f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:14:18,153 - lava_callback - INFO - Received callback for node 69a635e67da105ad0983651b INFO: 172.21.0.1:47790 - "POST /node/69a635e67da105ad0983651b HTTP/1.0" 202 Accepted 2026-03-05 01:14:18,158 - lava_callback - INFO - Starting async job submit for node 69a635e67da105ad0983651b 2026-03-05 01:14:18,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:18,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635e67da105ad0983651b HTTP/1.1" 200 None 2026-03-05 01:14:18,174 - lava_callback - DEBUG - Processing node 69a635e67da105ad0983651b: baseline-arm64-baylibre 2026-03-05 01:14:18,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a635e67da105ad0983651b 2026-03-05 01:14:18,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:18,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a635e67da105ad0983651b HTTP/1.1" 200 None 2026-03-05 01:14:18,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:18,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 01:14:18,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:18,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a635e67da105ad0983651b HTTP/1.1" 200 None 2026-03-05 01:14:18,235 - lava_callback - ERROR - Error processing callback for node 69a635e67da105ad0983651b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:14:43,151 - lava_callback - INFO - Received callback for node 69a8d8c4911a9cbe7f77dbcf INFO: 172.21.0.1:33836 - "POST /node/69a8d8c4911a9cbe7f77dbcf HTTP/1.0" 202 Accepted 2026-03-05 01:14:43,158 - lava_callback - INFO - Starting async job submit for node 69a8d8c4911a9cbe7f77dbcf 2026-03-05 01:14:43,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:43,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d8c4911a9cbe7f77dbcf HTTP/1.1" 200 None 2026-03-05 01:14:43,199 - lava_callback - DEBUG - Processing node 69a8d8c4911a9cbe7f77dbcf: baseline-arm64 2026-03-05 01:14:43,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:14:43,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:14:43,759 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d8c4911a9cbe7f77dbcf/log.txt.gz 2026-03-05 01:14:44,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:14:44,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:14:44,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d8c4911a9cbe7f77dbcf/lava-logs.yaml 2026-03-05 01:14:44,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:14:44,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:14:44,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d8c4911a9cbe7f77dbcf/lava_callback.json.gz 2026-03-05 01:14:44,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:44,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d8c4911a9cbe7f77dbcf HTTP/1.1" 200 None 2026-03-05 01:14:44,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:44,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:14:44,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:44,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d8c4911a9cbe7f77dbcf HTTP/1.1" 200 None 2026-03-05 01:14:44,499 - lava_callback - INFO - Completed processing callback for node 69a8d8c4911a9cbe7f77dbcf INFO: 172.21.0.1:33842 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:14:52,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:14:52,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:15:58,295 - lava_callback - INFO - Received callback for node 69a636487da105ad098365ab INFO: 172.21.0.1:35224 - "POST /node/69a636487da105ad098365ab HTTP/1.0" 202 Accepted 2026-03-05 01:15:58,307 - lava_callback - INFO - Starting async job submit for node 69a636487da105ad098365ab 2026-03-05 01:15:58,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:15:58,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a636487da105ad098365ab HTTP/1.1" 200 None 2026-03-05 01:15:58,360 - lava_callback - DEBUG - Processing node 69a636487da105ad098365ab: baseline-arm64-baylibre 2026-03-05 01:15:58,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a636487da105ad098365ab 2026-03-05 01:15:58,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:15:58,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a636487da105ad098365ab HTTP/1.1" 200 None 2026-03-05 01:15:58,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:15:58,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 01:15:58,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:15:58,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a636487da105ad098365ab HTTP/1.1" 200 None 2026-03-05 01:15:58,435 - lava_callback - ERROR - Error processing callback for node 69a636487da105ad098365ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39234 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:16:06,709 - lava_callback - INFO - Received callback for node 69a8d776911a9cbe7f77da70 INFO: 172.21.0.1:39244 - "POST /node/69a8d776911a9cbe7f77da70 HTTP/1.0" 202 Accepted 2026-03-05 01:16:06,715 - lava_callback - INFO - Starting async job submit for node 69a8d776911a9cbe7f77da70 2026-03-05 01:16:06,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:16:06,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d776911a9cbe7f77da70 HTTP/1.1" 200 None 2026-03-05 01:16:06,732 - lava_callback - DEBUG - Processing node 69a8d776911a9cbe7f77da70: baseline-nfs-arm64 2026-03-05 01:16:06,734 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:16:06,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:16:06,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:16:06,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d776911a9cbe7f77da70/lava-logs.yaml 2026-03-05 01:16:06,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:16:07,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:16:07,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d776911a9cbe7f77da70/lava_callback.json.gz 2026-03-05 01:16:07,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:16:07,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d776911a9cbe7f77da70 HTTP/1.1" 200 None 2026-03-05 01:16:07,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:16:07,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:16:07,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:16:07,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d776911a9cbe7f77da70 HTTP/1.1" 200 None 2026-03-05 01:16:07,108 - lava_callback - INFO - Completed processing callback for node 69a8d776911a9cbe7f77da70 INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:16:22,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:16:22,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:17:01,993 - lava_callback - INFO - Received callback for node 69a8d81a911a9cbe7f77db11 INFO: 172.21.0.1:51186 - "POST /node/69a8d81a911a9cbe7f77db11 HTTP/1.0" 202 Accepted 2026-03-05 01:17:02,000 - lava_callback - INFO - Starting async job submit for node 69a8d81a911a9cbe7f77db11 2026-03-05 01:17:02,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:02,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d81a911a9cbe7f77db11 HTTP/1.1" 200 None 2026-03-05 01:17:02,050 - lava_callback - DEBUG - Processing node 69a8d81a911a9cbe7f77db11: baseline-arm64 2026-03-05 01:17:02,187 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:17:02,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:17:02,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:17:02,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d81a911a9cbe7f77db11/lava-logs.yaml 2026-03-05 01:17:02,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:17:02,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:17:02,589 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d81a911a9cbe7f77db11/lava_callback.json.gz 2026-03-05 01:17:02,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:02,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d81a911a9cbe7f77db11 HTTP/1.1" 200 None 2026-03-05 01:17:02,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:02,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:17:02,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:02,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d81a911a9cbe7f77db11 HTTP/1.1" 200 None 2026-03-05 01:17:02,803 - lava_callback - INFO - Completed processing callback for node 69a8d81a911a9cbe7f77db11 INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:17:22,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:22,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49490 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:17:32,890 - lava_callback - INFO - Received callback for node 69a8d996911a9cbe7f77dc7a INFO: 172.21.0.1:32860 - "POST /node/69a8d996911a9cbe7f77dc7a HTTP/1.0" 202 Accepted 2026-03-05 01:17:32,902 - lava_callback - INFO - Starting async job submit for node 69a8d996911a9cbe7f77dc7a 2026-03-05 01:17:32,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:32,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d996911a9cbe7f77dc7a HTTP/1.1" 200 None 2026-03-05 01:17:32,922 - lava_callback - DEBUG - Processing node 69a8d996911a9cbe7f77dc7a: baseline-arm 2026-03-05 01:17:32,928 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:17:32,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:17:33,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:17:33,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d996911a9cbe7f77dc7a/lava-logs.yaml 2026-03-05 01:17:33,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:17:33,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:17:33,212 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d996911a9cbe7f77dc7a/lava_callback.json.gz 2026-03-05 01:17:33,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:33,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d996911a9cbe7f77dc7a HTTP/1.1" 200 None 2026-03-05 01:17:33,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:33,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:17:33,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:33,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d996911a9cbe7f77dc7a HTTP/1.1" 200 None 2026-03-05 01:17:33,286 - lava_callback - INFO - Completed processing callback for node 69a8d996911a9cbe7f77dc7a INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:17:38,391 - lava_callback - INFO - Received callback for node 69a636a47da105ad098365fe INFO: 172.21.0.1:32876 - "POST /node/69a636a47da105ad098365fe HTTP/1.0" 202 Accepted 2026-03-05 01:17:38,396 - lava_callback - INFO - Starting async job submit for node 69a636a47da105ad098365fe 2026-03-05 01:17:38,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:38,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a636a47da105ad098365fe HTTP/1.1" 200 None 2026-03-05 01:17:38,412 - lava_callback - DEBUG - Processing node 69a636a47da105ad098365fe: baseline-arm64-baylibre 2026-03-05 01:17:38,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a636a47da105ad098365fe 2026-03-05 01:17:38,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:38,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a636a47da105ad098365fe HTTP/1.1" 200 None 2026-03-05 01:17:38,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:38,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 01:17:38,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:38,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a636a47da105ad098365fe HTTP/1.1" 200 None 2026-03-05 01:17:38,473 - lava_callback - ERROR - Error processing callback for node 69a636a47da105ad098365fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:17:52,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:17:52,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:18:59,806 - lava_callback - INFO - Received callback for node 69a8d86f911a9cbe7f77db77 INFO: 172.21.0.1:34172 - "POST /node/69a8d86f911a9cbe7f77db77 HTTP/1.0" 202 Accepted 2026-03-05 01:18:59,820 - lava_callback - INFO - Starting async job submit for node 69a8d86f911a9cbe7f77db77 2026-03-05 01:18:59,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:18:59,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d86f911a9cbe7f77db77 HTTP/1.1" 200 None 2026-03-05 01:18:59,961 - lava_callback - DEBUG - Processing node 69a8d86f911a9cbe7f77db77: baseline-arm64 2026-03-05 01:19:00,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:19:00,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:19:00,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d86f911a9cbe7f77db77/log.txt.gz 2026-03-05 01:19:00,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:19:00,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:19:00,644 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d86f911a9cbe7f77db77/lava-logs.yaml 2026-03-05 01:19:00,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:19:00,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:19:00,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8d86f911a9cbe7f77db77/lava_callback.json.gz 2026-03-05 01:19:00,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:00,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d86f911a9cbe7f77db77 HTTP/1.1" 200 None 2026-03-05 01:19:00,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:00,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:19:00,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:01,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d86f911a9cbe7f77db77 HTTP/1.1" 200 None 2026-03-05 01:19:01,113 - lava_callback - INFO - Completed processing callback for node 69a8d86f911a9cbe7f77db77 INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:19:22,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:23,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:19:38,487 - lava_callback - INFO - Received callback for node 69a637267da105ad09836657 INFO: 172.21.0.1:59498 - "POST /node/69a637267da105ad09836657 HTTP/1.0" 202 Accepted 2026-03-05 01:19:38,496 - lava_callback - INFO - Starting async job submit for node 69a637267da105ad09836657 2026-03-05 01:19:38,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:38,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a637267da105ad09836657 HTTP/1.1" 200 None 2026-03-05 01:19:38,521 - lava_callback - DEBUG - Processing node 69a637267da105ad09836657: baseline-arm-baylibre 2026-03-05 01:19:38,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a637267da105ad09836657 2026-03-05 01:19:38,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:38,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a637267da105ad09836657 HTTP/1.1" 200 None 2026-03-05 01:19:38,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:38,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 01:19:38,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:38,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a637267da105ad09836657 HTTP/1.1" 200 None 2026-03-05 01:19:38,633 - lava_callback - ERROR - Error processing callback for node 69a637267da105ad09836657: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58316 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:19:46,655 - lava_callback - INFO - Received callback for node 69a8d64e911a9cbe7f77d7e1 INFO: 172.21.0.1:58318 - "POST /node/69a8d64e911a9cbe7f77d7e1 HTTP/1.0" 202 Accepted 2026-03-05 01:19:46,667 - lava_callback - INFO - Starting async job submit for node 69a8d64e911a9cbe7f77d7e1 2026-03-05 01:19:46,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:46,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64e911a9cbe7f77d7e1 HTTP/1.1" 200 None 2026-03-05 01:19:46,806 - lava_callback - DEBUG - Processing node 69a8d64e911a9cbe7f77d7e1: baseline-arm 2026-03-05 01:19:47,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:19:47,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:19:47,666 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64e911a9cbe7f77d7e1/log.txt.gz 2026-03-05 01:19:48,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:19:48,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:19:48,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64e911a9cbe7f77d7e1/lava-logs.yaml 2026-03-05 01:19:48,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:19:48,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:19:48,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8d64e911a9cbe7f77d7e1/lava_callback.json.gz DEBUG: Setup failed for 69a8d64e911a9cbe7f77d7e1. Transitting job node result: incomplete -> fail 2026-03-05 01:19:49,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:49,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64e911a9cbe7f77d7e1 HTTP/1.1" 200 None 2026-03-05 01:19:49,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:49,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:19:49,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:49,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d64e911a9cbe7f77d7e1 HTTP/1.1" 200 None 2026-03-05 01:19:49,279 - lava_callback - INFO - Completed processing callback for node 69a8d64e911a9cbe7f77d7e1 2026-03-05 01:19:53,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:19:53,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:21:05,264 - lava_callback - INFO - Received callback for node 69a8d5c9911a9cbe7f77d650 INFO: 172.21.0.1:46366 - "POST /node/69a8d5c9911a9cbe7f77d650 HTTP/1.0" 202 Accepted 2026-03-05 01:21:05,280 - lava_callback - INFO - Starting async job submit for node 69a8d5c9911a9cbe7f77d650 2026-03-05 01:21:05,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:05,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c9911a9cbe7f77d650 HTTP/1.1" 200 None 2026-03-05 01:21:05,381 - lava_callback - DEBUG - Processing node 69a8d5c9911a9cbe7f77d650: baseline-nfs-arm64 INFO: 172.21.0.1:46376 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:21:07,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:21:07,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:21:07,283 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c9911a9cbe7f77d650/log.txt.gz 2026-03-05 01:21:08,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:21:08,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:21:08,603 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c9911a9cbe7f77d650/lava-logs.yaml 2026-03-05 01:21:08,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:21:08,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:21:08,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8d5c9911a9cbe7f77d650/lava_callback.json.gz DEBUG: Setup failed for 69a8d5c9911a9cbe7f77d650. Transitting job node result: incomplete -> fail 2026-03-05 01:21:08,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:08,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5c9911a9cbe7f77d650 HTTP/1.1" 200 None 2026-03-05 01:21:08,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:08,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:21:08,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:08,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5c9911a9cbe7f77d650 HTTP/1.1" 200 None 2026-03-05 01:21:09,072 - lava_callback - INFO - Completed processing callback for node 69a8d5c9911a9cbe7f77d650 INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:21:21,886 - lava_callback - INFO - Received callback for node 69a8da78911a9cbe7f77dd1f INFO: 172.21.0.1:58320 - "POST /node/69a8da78911a9cbe7f77dd1f HTTP/1.0" 202 Accepted 2026-03-05 01:21:21,897 - lava_callback - INFO - Starting async job submit for node 69a8da78911a9cbe7f77dd1f 2026-03-05 01:21:21,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:21,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8da78911a9cbe7f77dd1f HTTP/1.1" 200 None 2026-03-05 01:21:21,930 - lava_callback - DEBUG - Processing node 69a8da78911a9cbe7f77dd1f: baseline-nfs-arm64 2026-03-05 01:21:21,933 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:21:21,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:21:22,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:21:22,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8da78911a9cbe7f77dd1f/lava-logs.yaml 2026-03-05 01:21:22,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:21:22,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:21:22,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8da78911a9cbe7f77dd1f/lava_callback.json.gz 2026-03-05 01:21:22,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:22,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8da78911a9cbe7f77dd1f HTTP/1.1" 200 None 2026-03-05 01:21:22,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:22,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:21:22,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:22,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8da78911a9cbe7f77dd1f HTTP/1.1" 200 None 2026-03-05 01:21:22,527 - lava_callback - INFO - Completed processing callback for node 69a8da78911a9cbe7f77dd1f 2026-03-05 01:21:23,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:21:23,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:22:35,833 - lava_callback - INFO - Received callback for node 69a8d65c911a9cbe7f77d83f INFO: 172.21.0.1:50734 - "POST /node/69a8d65c911a9cbe7f77d83f HTTP/1.0" 202 Accepted 2026-03-05 01:22:35,844 - lava_callback - INFO - Starting async job submit for node 69a8d65c911a9cbe7f77d83f 2026-03-05 01:22:35,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:22:35,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d65c911a9cbe7f77d83f HTTP/1.1" 200 None 2026-03-05 01:22:35,923 - lava_callback - DEBUG - Processing node 69a8d65c911a9cbe7f77d83f: baseline-arm-clabbe 2026-03-05 01:22:36,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:22:36,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:22:36,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d65c911a9cbe7f77d83f/log.txt.gz INFO: 172.21.0.1:50750 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:22:36,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:22:36,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:22:36,730 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d65c911a9cbe7f77d83f/lava-logs.yaml 2026-03-05 01:22:36,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:22:36,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:22:36,957 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8d65c911a9cbe7f77d83f/lava_callback.json.gz DEBUG: Setup failed for 69a8d65c911a9cbe7f77d83f. Transitting job node result: incomplete -> fail 2026-03-05 01:22:37,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:22:37,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d65c911a9cbe7f77d83f HTTP/1.1" 200 None 2026-03-05 01:22:37,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:22:37,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:22:37,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:22:37,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d65c911a9cbe7f77d83f HTTP/1.1" 200 None 2026-03-05 01:22:37,252 - lava_callback - INFO - Completed processing callback for node 69a8d65c911a9cbe7f77d83f INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:22:53,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:22:53,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53580 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:24:04,927 - lava_callback - INFO - Received callback for node 69a8d66f911a9cbe7f77d8b5 INFO: 172.21.0.1:45526 - "POST /node/69a8d66f911a9cbe7f77d8b5 HTTP/1.0" 202 Accepted 2026-03-05 01:24:04,974 - lava_callback - INFO - Starting async job submit for node 69a8d66f911a9cbe7f77d8b5 2026-03-05 01:24:05,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:24:05,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d66f911a9cbe7f77d8b5 HTTP/1.1" 200 None 2026-03-05 01:24:05,042 - lava_callback - DEBUG - Processing node 69a8d66f911a9cbe7f77d8b5: baseline-arm-pengutronix 2026-03-05 01:24:05,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:24:05,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:24:05,357 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66f911a9cbe7f77d8b5/log.txt.gz 2026-03-05 01:24:05,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:24:05,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:24:05,635 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66f911a9cbe7f77d8b5/lava-logs.yaml 2026-03-05 01:24:05,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:24:05,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:24:05,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8d66f911a9cbe7f77d8b5/lava_callback.json.gz DEBUG: Setup failed for 69a8d66f911a9cbe7f77d8b5. Transitting job node result: incomplete -> fail 2026-03-05 01:24:05,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:24:05,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d66f911a9cbe7f77d8b5 HTTP/1.1" 200 None 2026-03-05 01:24:05,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:24:05,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:24:05,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:24:05,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d66f911a9cbe7f77d8b5 HTTP/1.1" 200 None 2026-03-05 01:24:05,990 - lava_callback - INFO - Completed processing callback for node 69a8d66f911a9cbe7f77d8b5 INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:24:23,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:24:23,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:25:07,075 - lava_callback - INFO - Received callback for node 69a8db50911a9cbe7f77ddc9 INFO: 172.21.0.1:56386 - "POST /node/69a8db50911a9cbe7f77ddc9 HTTP/1.0" 202 Accepted 2026-03-05 01:25:07,081 - lava_callback - INFO - Starting async job submit for node 69a8db50911a9cbe7f77ddc9 2026-03-05 01:25:07,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:25:07,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8db50911a9cbe7f77ddc9 HTTP/1.1" 200 None 2026-03-05 01:25:07,100 - lava_callback - DEBUG - Processing node 69a8db50911a9cbe7f77ddc9: baseline-nfs-arm64 2026-03-05 01:25:07,101 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:25:07,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:25:07,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:25:07,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8db50911a9cbe7f77ddc9/lava-logs.yaml 2026-03-05 01:25:07,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:25:07,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:25:07,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8db50911a9cbe7f77ddc9/lava_callback.json.gz 2026-03-05 01:25:07,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:25:07,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8db50911a9cbe7f77ddc9 HTTP/1.1" 200 None 2026-03-05 01:25:07,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:25:07,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:25:07,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:25:07,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8db50911a9cbe7f77ddc9 HTTP/1.1" 200 None 2026-03-05 01:25:07,462 - lava_callback - INFO - Completed processing callback for node 69a8db50911a9cbe7f77ddc9 INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:25:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:25:23,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:26:38,901 - lava_callback - INFO - Received callback for node 69a638c27da105ad0983679a INFO: 172.21.0.1:38464 - "POST /node/69a638c27da105ad0983679a HTTP/1.0" 202 Accepted 2026-03-05 01:26:38,907 - lava_callback - INFO - Starting async job submit for node 69a638c27da105ad0983679a 2026-03-05 01:26:38,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:26:38,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a638c27da105ad0983679a HTTP/1.1" 200 None 2026-03-05 01:26:38,933 - lava_callback - DEBUG - Processing node 69a638c27da105ad0983679a: baseline-arm-baylibre 2026-03-05 01:26:38,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a638c27da105ad0983679a 2026-03-05 01:26:38,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:26:38,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a638c27da105ad0983679a HTTP/1.1" 200 None 2026-03-05 01:26:38,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:26:38,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 01:26:38,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:26:38,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a638c27da105ad0983679a HTTP/1.1" 200 None 2026-03-05 01:26:38,985 - lava_callback - ERROR - Error processing callback for node 69a638c27da105ad0983679a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:28:59,064 - lava_callback - INFO - Received callback for node 69a6394d7da105ad09836811 INFO: 172.21.0.1:56206 - "POST /node/69a6394d7da105ad09836811 HTTP/1.0" 202 Accepted 2026-03-05 01:28:59,070 - lava_callback - INFO - Starting async job submit for node 69a6394d7da105ad09836811 2026-03-05 01:28:59,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:28:59,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6394d7da105ad09836811 HTTP/1.1" 200 None 2026-03-05 01:28:59,086 - lava_callback - DEBUG - Processing node 69a6394d7da105ad09836811: baseline-arm-baylibre 2026-03-05 01:28:59,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6394d7da105ad09836811 2026-03-05 01:28:59,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:28:59,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6394d7da105ad09836811 HTTP/1.1" 200 None 2026-03-05 01:28:59,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:28:59,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 01:28:59,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:28:59,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6394d7da105ad09836811 HTTP/1.1" 200 None 2026-03-05 01:28:59,142 - lava_callback - ERROR - Error processing callback for node 69a6394d7da105ad09836811: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:29:39,010 - lava_callback - INFO - Received callback for node 69a639807da105ad09836825 INFO: 172.21.0.1:43238 - "POST /node/69a639807da105ad09836825 HTTP/1.0" 202 Accepted 2026-03-05 01:29:39,016 - lava_callback - INFO - Starting async job submit for node 69a639807da105ad09836825 2026-03-05 01:29:39,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:29:39,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a639807da105ad09836825 HTTP/1.1" 200 None 2026-03-05 01:29:39,035 - lava_callback - DEBUG - Processing node 69a639807da105ad09836825: baseline-arm-baylibre 2026-03-05 01:29:39,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a639807da105ad09836825 2026-03-05 01:29:39,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:29:39,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a639807da105ad09836825 HTTP/1.1" 200 None 2026-03-05 01:29:39,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:29:39,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 01:29:39,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:29:39,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a639807da105ad09836825 HTTP/1.1" 200 None 2026-03-05 01:29:39,095 - lava_callback - ERROR - Error processing callback for node 69a639807da105ad09836825: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:30:29,937 - lava_callback - INFO - Received callback for node 69a8dc9f911a9cbe7f77de96 INFO: 172.21.0.1:43974 - "POST /node/69a8dc9f911a9cbe7f77de96 HTTP/1.0" 202 Accepted 2026-03-05 01:30:29,944 - lava_callback - INFO - Starting async job submit for node 69a8dc9f911a9cbe7f77de96 2026-03-05 01:30:29,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:29,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dc9f911a9cbe7f77de96 HTTP/1.1" 200 None 2026-03-05 01:30:29,961 - lava_callback - DEBUG - Processing node 69a8dc9f911a9cbe7f77de96: baseline-nfs-arm64 2026-03-05 01:30:29,963 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:30:29,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:30:30,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:30:30,210 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8dc9f911a9cbe7f77de96/lava-logs.yaml 2026-03-05 01:30:30,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:30:30,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:30:30,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8dc9f911a9cbe7f77de96/lava_callback.json.gz 2026-03-05 01:30:30,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:30,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dc9f911a9cbe7f77de96 HTTP/1.1" 200 None 2026-03-05 01:30:30,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:30,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:30:30,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:30,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dc9f911a9cbe7f77de96 HTTP/1.1" 200 None 2026-03-05 01:30:30,402 - lava_callback - INFO - Completed processing callback for node 69a8dc9f911a9cbe7f77de96 INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:30:39,109 - lava_callback - INFO - Received callback for node 69a639b27da105ad09836859 INFO: 172.21.0.1:43992 - "POST /node/69a639b27da105ad09836859 HTTP/1.0" 202 Accepted 2026-03-05 01:30:39,117 - lava_callback - INFO - Starting async job submit for node 69a639b27da105ad09836859 2026-03-05 01:30:39,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:39,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a639b27da105ad09836859 HTTP/1.1" 200 None 2026-03-05 01:30:39,141 - lava_callback - DEBUG - Processing node 69a639b27da105ad09836859: baseline-arm-baylibre 2026-03-05 01:30:39,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a639b27da105ad09836859 2026-03-05 01:30:39,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:39,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a639b27da105ad09836859 HTTP/1.1" 200 None 2026-03-05 01:30:39,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:39,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 01:30:39,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:39,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a639b27da105ad09836859 HTTP/1.1" 200 None 2026-03-05 01:30:39,223 - lava_callback - ERROR - Error processing callback for node 69a639b27da105ad09836859: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:30:53,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:30:53,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37910 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:31:51,355 - lava_callback - INFO - Received callback for node 69a8dbb4911a9cbe7f77de03 INFO: 172.21.0.1:38486 - "POST /node/69a8dbb4911a9cbe7f77de03 HTTP/1.0" 202 Accepted 2026-03-05 01:31:51,365 - lava_callback - INFO - Starting async job submit for node 69a8dbb4911a9cbe7f77de03 2026-03-05 01:31:51,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:31:51,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dbb4911a9cbe7f77de03 HTTP/1.1" 200 None 2026-03-05 01:31:51,436 - lava_callback - DEBUG - Processing node 69a8dbb4911a9cbe7f77de03: baseline-arm64-foundriesio 2026-03-05 01:31:52,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:31:52,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:31:52,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8dbb4911a9cbe7f77de03/log.txt.gz 2026-03-05 01:31:53,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:31:53,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:31:53,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8dbb4911a9cbe7f77de03/lava-logs.yaml 2026-03-05 01:31:53,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:31:53,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:31:53,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8dbb4911a9cbe7f77de03/lava_callback.json.gz DEBUG: Setup failed for 69a8dbb4911a9cbe7f77de03. Transitting job node result: incomplete -> fail 2026-03-05 01:31:54,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:31:54,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dbb4911a9cbe7f77de03 HTTP/1.1" 200 None 2026-03-05 01:31:54,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:31:54,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:31:54,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:31:54,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dbb4911a9cbe7f77de03 HTTP/1.1" 200 None 2026-03-05 01:31:54,251 - lava_callback - INFO - Completed processing callback for node 69a8dbb4911a9cbe7f77de03 INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:32:23,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:32:23,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:32:59,274 - lava_callback - INFO - Received callback for node 69a63a417da105ad098368de INFO: 172.21.0.1:52168 - "POST /node/69a63a417da105ad098368de HTTP/1.0" 202 Accepted 2026-03-05 01:32:59,280 - lava_callback - INFO - Starting async job submit for node 69a63a417da105ad098368de 2026-03-05 01:32:59,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:32:59,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a63a417da105ad098368de HTTP/1.1" 200 None 2026-03-05 01:32:59,296 - lava_callback - DEBUG - Processing node 69a63a417da105ad098368de: baseline-arm-baylibre 2026-03-05 01:32:59,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a63a417da105ad098368de 2026-03-05 01:32:59,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:32:59,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a63a417da105ad098368de HTTP/1.1" 200 None 2026-03-05 01:32:59,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:32:59,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 01:32:59,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:32:59,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a63a417da105ad098368de HTTP/1.1" 200 None 2026-03-05 01:32:59,349 - lava_callback - ERROR - Error processing callback for node 69a63a417da105ad098368de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:34:58,190 - lava_callback - INFO - Received callback for node 69a8dbf2911a9cbe7f77de2d INFO: 172.21.0.1:36270 - "POST /node/69a8dbf2911a9cbe7f77de2d HTTP/1.0" 202 Accepted 2026-03-05 01:34:58,197 - lava_callback - INFO - Starting async job submit for node 69a8dbf2911a9cbe7f77de2d 2026-03-05 01:34:58,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:34:58,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dbf2911a9cbe7f77de2d HTTP/1.1" 200 None 2026-03-05 01:34:58,249 - lava_callback - DEBUG - Processing node 69a8dbf2911a9cbe7f77de2d: baseline-arm64 2026-03-05 01:34:58,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:34:58,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:34:58,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8dbf2911a9cbe7f77de2d/log.txt.gz 2026-03-05 01:34:59,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:34:59,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:34:59,258 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8dbf2911a9cbe7f77de2d/lava-logs.yaml 2026-03-05 01:34:59,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:34:59,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:34:59,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8dbf2911a9cbe7f77de2d/lava_callback.json.gz DEBUG: Setup failed for 69a8dbf2911a9cbe7f77de2d. Transitting job node result: incomplete -> fail 2026-03-05 01:34:59,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:34:59,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dbf2911a9cbe7f77de2d HTTP/1.1" 200 None 2026-03-05 01:34:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:34:59,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:34:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:34:59,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dbf2911a9cbe7f77de2d HTTP/1.1" 200 None 2026-03-05 01:34:59,670 - lava_callback - INFO - Completed processing callback for node 69a8dbf2911a9cbe7f77de2d INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:35:23,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:35:23,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:49:47,769 - lava_callback - INFO - Received callback for node 69a8e123911a9cbe7f77e218 INFO: 172.21.0.1:35874 - "POST /node/69a8e123911a9cbe7f77e218 HTTP/1.0" 202 Accepted 2026-03-05 01:49:47,776 - lava_callback - INFO - Starting async job submit for node 69a8e123911a9cbe7f77e218 2026-03-05 01:49:47,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:49:47,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e123911a9cbe7f77e218 HTTP/1.1" 200 None 2026-03-05 01:49:47,801 - lava_callback - DEBUG - Processing node 69a8e123911a9cbe7f77e218: baseline-nfs-arm64 2026-03-05 01:49:47,803 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:49:47,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:49:47,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:49:47,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e123911a9cbe7f77e218/lava-logs.yaml 2026-03-05 01:49:47,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:49:48,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:49:48,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e123911a9cbe7f77e218/lava_callback.json.gz 2026-03-05 01:49:48,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:49:48,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e123911a9cbe7f77e218 HTTP/1.1" 200 None 2026-03-05 01:49:48,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:49:48,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:49:48,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:49:48,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e123911a9cbe7f77e218 HTTP/1.1" 200 None 2026-03-05 01:49:48,202 - lava_callback - INFO - Completed processing callback for node 69a8e123911a9cbe7f77e218 2026-03-05 01:49:53,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:49:53,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51380 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:50:31,382 - lava_callback - INFO - Received callback for node 69a8dd3a911a9cbe7f77df08 INFO: 172.21.0.1:41246 - "POST /node/69a8dd3a911a9cbe7f77df08 HTTP/1.0" 202 Accepted 2026-03-05 01:50:31,389 - lava_callback - INFO - Starting async job submit for node 69a8dd3a911a9cbe7f77df08 2026-03-05 01:50:31,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:50:31,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dd3a911a9cbe7f77df08 HTTP/1.1" 200 None 2026-03-05 01:50:31,464 - lava_callback - DEBUG - Processing node 69a8dd3a911a9cbe7f77df08: ltp-smoke 2026-03-05 01:50:31,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:50:32,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:50:32,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8dd3a911a9cbe7f77df08/log.txt.gz 2026-03-05 01:50:32,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:50:32,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:50:32,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8dd3a911a9cbe7f77df08/lava-logs.yaml 2026-03-05 01:50:32,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:50:32,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:50:32,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8dd3a911a9cbe7f77df08/lava_callback.json.gz 2026-03-05 01:50:32,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:50:33,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dd3a911a9cbe7f77df08 HTTP/1.1" 200 None 2026-03-05 01:50:33,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:50:33,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbc3911a9cbe7f77ccb1 HTTP/1.1" 200 None 2026-03-05 01:50:33,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:50:33,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dd3a911a9cbe7f77df08 HTTP/1.1" 200 None 2026-03-05 01:50:33,187 - lava_callback - INFO - Completed processing callback for node 69a8dd3a911a9cbe7f77df08 INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:50:53,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:50:53,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:54:01,145 - lava_callback - INFO - Received callback for node 69a8e1ff911a9cbe7f77e332 INFO: 172.21.0.1:59454 - "POST /node/69a8e1ff911a9cbe7f77e332 HTTP/1.0" 202 Accepted 2026-03-05 01:54:01,152 - lava_callback - INFO - Starting async job submit for node 69a8e1ff911a9cbe7f77e332 2026-03-05 01:54:01,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:01,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e1ff911a9cbe7f77e332 HTTP/1.1" 200 None 2026-03-05 01:54:01,196 - lava_callback - DEBUG - Processing node 69a8e1ff911a9cbe7f77e332: baseline-arm64 2026-03-05 01:54:01,332 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:54:01,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:54:01,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:54:01,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8e1ff911a9cbe7f77e332/lava-logs.yaml 2026-03-05 01:54:01,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:54:01,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:54:01,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8e1ff911a9cbe7f77e332/lava_callback.json.gz 2026-03-05 01:54:01,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:01,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e1ff911a9cbe7f77e332 HTTP/1.1" 200 None 2026-03-05 01:54:01,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:01,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 01:54:01,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:01,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e1ff911a9cbe7f77e332 HTTP/1.1" 200 None 2026-03-05 01:54:01,913 - lava_callback - INFO - Completed processing callback for node 69a8e1ff911a9cbe7f77e332 INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:54:23,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:23,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:54:34,518 - lava_callback - INFO - Received callback for node 69a8e254911a9cbe7f77e364 INFO: 172.21.0.1:54228 - "POST /node/69a8e254911a9cbe7f77e364 HTTP/1.0" 202 Accepted 2026-03-05 01:54:34,524 - lava_callback - INFO - Starting async job submit for node 69a8e254911a9cbe7f77e364 2026-03-05 01:54:34,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:34,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e254911a9cbe7f77e364 HTTP/1.1" 200 None 2026-03-05 01:54:34,542 - lava_callback - DEBUG - Processing node 69a8e254911a9cbe7f77e364: baseline-arm 2026-03-05 01:54:34,548 - lava_callback - WARNING - Failed to upload log 2026-03-05 01:54:34,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:54:34,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:54:34,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8e254911a9cbe7f77e364/lava-logs.yaml 2026-03-05 01:54:34,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 01:54:34,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 01:54:34,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8e254911a9cbe7f77e364/lava_callback.json.gz 2026-03-05 01:54:34,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:34,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e254911a9cbe7f77e364 HTTP/1.1" 200 None 2026-03-05 01:54:34,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:34,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 01:54:34,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:34,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e254911a9cbe7f77e364 HTTP/1.1" 200 None 2026-03-05 01:54:34,998 - lava_callback - INFO - Completed processing callback for node 69a8e254911a9cbe7f77e364 INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:54:53,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:54:53,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK 2026-03-05 01:59:00,836 - lava_callback - INFO - Received callback for node 69a640627da105ad09836c5c INFO: 172.21.0.1:48004 - "POST /node/69a640627da105ad09836c5c HTTP/1.0" 202 Accepted 2026-03-05 01:59:00,841 - lava_callback - INFO - Starting async job submit for node 69a640627da105ad09836c5c 2026-03-05 01:59:00,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:59:00,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a640627da105ad09836c5c HTTP/1.1" 200 None 2026-03-05 01:59:00,863 - lava_callback - DEBUG - Processing node 69a640627da105ad09836c5c: baseline-arm-baylibre 2026-03-05 01:59:00,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a640627da105ad09836c5c 2026-03-05 01:59:00,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:59:00,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a640627da105ad09836c5c HTTP/1.1" 200 None 2026-03-05 01:59:00,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:59:00,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 01:59:00,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 01:59:00,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a640627da105ad09836c5c HTTP/1.1" 200 None 2026-03-05 01:59:00,937 - lava_callback - ERROR - Error processing callback for node 69a640627da105ad09836c5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:00:00,681 - lava_callback - INFO - Received callback for node 69a640957da105ad09836c96 INFO: 172.21.0.1:34444 - "POST /node/69a640957da105ad09836c96 HTTP/1.0" 202 Accepted 2026-03-05 02:00:00,687 - lava_callback - INFO - Starting async job submit for node 69a640957da105ad09836c96 2026-03-05 02:00:00,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:00:00,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a640957da105ad09836c96 HTTP/1.1" 200 None 2026-03-05 02:00:00,704 - lava_callback - DEBUG - Processing node 69a640957da105ad09836c96: baseline-arm-baylibre 2026-03-05 02:00:00,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a640957da105ad09836c96 2026-03-05 02:00:00,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:00:00,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a640957da105ad09836c96 HTTP/1.1" 200 None 2026-03-05 02:00:00,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:00:00,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 02:00:00,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:00:00,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a640957da105ad09836c96 HTTP/1.1" 200 None 2026-03-05 02:00:00,757 - lava_callback - ERROR - Error processing callback for node 69a640957da105ad09836c96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:00:54,165 - lava_callback - INFO - Received callback for node 69a8e38e911a9cbe7f77e4f6 INFO: 172.21.0.1:37474 - "POST /node/69a8e38e911a9cbe7f77e4f6 HTTP/1.0" 202 Accepted 2026-03-05 02:00:54,172 - lava_callback - INFO - Starting async job submit for node 69a8e38e911a9cbe7f77e4f6 2026-03-05 02:00:54,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:00:54,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e38e911a9cbe7f77e4f6 HTTP/1.1" 200 None 2026-03-05 02:00:54,215 - lava_callback - DEBUG - Processing node 69a8e38e911a9cbe7f77e4f6: baseline-arm64 2026-03-05 02:00:54,414 - lava_callback - WARNING - Failed to upload log 2026-03-05 02:00:54,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:00:54,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:00:54,703 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8e38e911a9cbe7f77e4f6/lava-logs.yaml 2026-03-05 02:00:54,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:00:54,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:00:54,825 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8e38e911a9cbe7f77e4f6/lava_callback.json.gz 2026-03-05 02:00:54,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:00:54,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e38e911a9cbe7f77e4f6 HTTP/1.1" 200 None 2026-03-05 02:00:54,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:00:54,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:00:54,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:00:54,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e38e911a9cbe7f77e4f6 HTTP/1.1" 200 None 2026-03-05 02:00:54,977 - lava_callback - INFO - Completed processing callback for node 69a8e38e911a9cbe7f77e4f6 INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:01:00,814 - lava_callback - INFO - Received callback for node 69a640c87da105ad09836cd6 INFO: 172.21.0.1:51234 - "POST /node/69a640c87da105ad09836cd6 HTTP/1.0" 202 Accepted 2026-03-05 02:01:00,820 - lava_callback - INFO - Starting async job submit for node 69a640c87da105ad09836cd6 2026-03-05 02:01:00,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:00,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a640c87da105ad09836cd6 HTTP/1.1" 200 None 2026-03-05 02:01:00,838 - lava_callback - DEBUG - Processing node 69a640c87da105ad09836cd6: baseline-arm-baylibre 2026-03-05 02:01:00,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a640c87da105ad09836cd6 2026-03-05 02:01:00,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:00,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a640c87da105ad09836cd6 HTTP/1.1" 200 None 2026-03-05 02:01:00,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:00,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 02:01:00,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:00,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a640c87da105ad09836cd6 HTTP/1.1" 200 None 2026-03-05 02:01:00,898 - lava_callback - ERROR - Error processing callback for node 69a640c87da105ad09836cd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:01:23,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:23,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:01:40,795 - lava_callback - INFO - Received callback for node 69a640f97da105ad09836ce9 INFO: 172.21.0.1:55570 - "POST /node/69a640f97da105ad09836ce9 HTTP/1.0" 202 Accepted 2026-03-05 02:01:40,801 - lava_callback - INFO - Starting async job submit for node 69a640f97da105ad09836ce9 2026-03-05 02:01:40,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:40,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a640f97da105ad09836ce9 HTTP/1.1" 200 None 2026-03-05 02:01:40,821 - lava_callback - DEBUG - Processing node 69a640f97da105ad09836ce9: baseline-arm-baylibre 2026-03-05 02:01:40,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a640f97da105ad09836ce9 2026-03-05 02:01:40,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:40,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a640f97da105ad09836ce9 HTTP/1.1" 200 None 2026-03-05 02:01:40,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:40,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 02:01:40,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:01:40,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a640f97da105ad09836ce9 HTTP/1.1" 200 None 2026-03-05 02:01:40,885 - lava_callback - ERROR - Error processing callback for node 69a640f97da105ad09836ce9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:02:40,877 - lava_callback - INFO - Received callback for node 69a6412e7da105ad09836d22 INFO: 172.21.0.1:44686 - "POST /node/69a6412e7da105ad09836d22 HTTP/1.0" 202 Accepted 2026-03-05 02:02:40,883 - lava_callback - INFO - Starting async job submit for node 69a6412e7da105ad09836d22 2026-03-05 02:02:40,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:02:40,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6412e7da105ad09836d22 HTTP/1.1" 200 None 2026-03-05 02:02:40,898 - lava_callback - DEBUG - Processing node 69a6412e7da105ad09836d22: baseline-arm-baylibre 2026-03-05 02:02:40,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6412e7da105ad09836d22 2026-03-05 02:02:40,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:02:40,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6412e7da105ad09836d22 HTTP/1.1" 200 None 2026-03-05 02:02:40,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:02:40,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 02:02:40,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:02:40,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6412e7da105ad09836d22 HTTP/1.1" 200 None 2026-03-05 02:02:40,951 - lava_callback - ERROR - Error processing callback for node 69a6412e7da105ad09836d22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:03:20,873 - lava_callback - INFO - Received callback for node 69a6415f7da105ad09836d5a INFO: 172.21.0.1:42654 - "POST /node/69a6415f7da105ad09836d5a HTTP/1.0" 202 Accepted 2026-03-05 02:03:20,879 - lava_callback - INFO - Starting async job submit for node 69a6415f7da105ad09836d5a 2026-03-05 02:03:20,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:03:20,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6415f7da105ad09836d5a HTTP/1.1" 200 None 2026-03-05 02:03:20,896 - lava_callback - DEBUG - Processing node 69a6415f7da105ad09836d5a: baseline-arm-baylibre 2026-03-05 02:03:20,896 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6415f7da105ad09836d5a 2026-03-05 02:03:20,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:03:20,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6415f7da105ad09836d5a HTTP/1.1" 200 None 2026-03-05 02:03:20,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:03:20,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 02:03:20,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:03:20,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6415f7da105ad09836d5a HTTP/1.1" 200 None 2026-03-05 02:03:20,956 - lava_callback - ERROR - Error processing callback for node 69a6415f7da105ad09836d5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:06:07,721 - lava_callback - INFO - Received callback for node 69a8e4f5911a9cbe7f77e687 INFO: 172.21.0.1:41518 - "POST /node/69a8e4f5911a9cbe7f77e687 HTTP/1.0" 202 Accepted 2026-03-05 02:06:07,727 - lava_callback - INFO - Starting async job submit for node 69a8e4f5911a9cbe7f77e687 2026-03-05 02:06:07,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:06:07,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e4f5911a9cbe7f77e687 HTTP/1.1" 200 None 2026-03-05 02:06:07,746 - lava_callback - DEBUG - Processing node 69a8e4f5911a9cbe7f77e687: baseline-nfs-arm64 2026-03-05 02:06:07,748 - lava_callback - WARNING - Failed to upload log 2026-03-05 02:06:07,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:06:07,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:06:07,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e4f5911a9cbe7f77e687/lava-logs.yaml 2026-03-05 02:06:07,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:06:08,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:06:08,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e4f5911a9cbe7f77e687/lava_callback.json.gz 2026-03-05 02:06:08,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:06:08,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e4f5911a9cbe7f77e687 HTTP/1.1" 200 None 2026-03-05 02:06:08,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:06:08,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:06:08,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:06:08,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e4f5911a9cbe7f77e687 HTTP/1.1" 200 None 2026-03-05 02:06:08,132 - lava_callback - INFO - Completed processing callback for node 69a8e4f5911a9cbe7f77e687 INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50750 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:06:23,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:06:23,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:10:41,616 - lava_callback - INFO - Received callback for node 69a8e603911a9cbe7f77e78c INFO: 172.21.0.1:39308 - "POST /node/69a8e603911a9cbe7f77e78c HTTP/1.0" 202 Accepted 2026-03-05 02:10:41,622 - lava_callback - INFO - Starting async job submit for node 69a8e603911a9cbe7f77e78c 2026-03-05 02:10:41,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:10:41,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e603911a9cbe7f77e78c HTTP/1.1" 200 None 2026-03-05 02:10:41,640 - lava_callback - DEBUG - Processing node 69a8e603911a9cbe7f77e78c: baseline-nfs-arm64 2026-03-05 02:10:41,642 - lava_callback - WARNING - Failed to upload log 2026-03-05 02:10:41,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:10:41,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:10:41,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e603911a9cbe7f77e78c/lava-logs.yaml 2026-03-05 02:10:41,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:10:42,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:10:42,007 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e603911a9cbe7f77e78c/lava_callback.json.gz 2026-03-05 02:10:42,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:10:42,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e603911a9cbe7f77e78c HTTP/1.1" 200 None 2026-03-05 02:10:42,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:10:42,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:10:42,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:10:42,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e603911a9cbe7f77e78c HTTP/1.1" 200 None 2026-03-05 02:10:42,079 - lava_callback - INFO - Completed processing callback for node 69a8e603911a9cbe7f77e78c INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:10:53,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:10:53,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:14:31,603 - lava_callback - INFO - Received callback for node 69a8e6e3911a9cbe7f77e886 INFO: 172.21.0.1:38108 - "POST /node/69a8e6e3911a9cbe7f77e886 HTTP/1.0" 202 Accepted 2026-03-05 02:14:31,610 - lava_callback - INFO - Starting async job submit for node 69a8e6e3911a9cbe7f77e886 2026-03-05 02:14:31,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:14:31,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e6e3911a9cbe7f77e886 HTTP/1.1" 200 None 2026-03-05 02:14:31,630 - lava_callback - DEBUG - Processing node 69a8e6e3911a9cbe7f77e886: baseline-nfs-arm64 2026-03-05 02:14:31,631 - lava_callback - WARNING - Failed to upload log 2026-03-05 02:14:31,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:14:31,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:14:31,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e6e3911a9cbe7f77e886/lava-logs.yaml 2026-03-05 02:14:31,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:14:31,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:14:31,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e6e3911a9cbe7f77e886/lava_callback.json.gz 2026-03-05 02:14:31,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:14:31,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e6e3911a9cbe7f77e886 HTTP/1.1" 200 None 2026-03-05 02:14:31,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:14:31,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:14:31,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:14:32,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e6e3911a9cbe7f77e886 HTTP/1.1" 200 None 2026-03-05 02:14:32,013 - lava_callback - INFO - Completed processing callback for node 69a8e6e3911a9cbe7f77e886 INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:14:53,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:14:53,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:18:39,792 - lava_callback - INFO - Received callback for node 69a8e43c911a9cbe7f77e5bb INFO: 172.21.0.1:51500 - "POST /node/69a8e43c911a9cbe7f77e5bb HTTP/1.0" 202 Accepted 2026-03-05 02:18:39,799 - lava_callback - INFO - Starting async job submit for node 69a8e43c911a9cbe7f77e5bb 2026-03-05 02:18:39,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:18:39,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e43c911a9cbe7f77e5bb HTTP/1.1" 200 None 2026-03-05 02:18:39,872 - lava_callback - DEBUG - Processing node 69a8e43c911a9cbe7f77e5bb: baseline-arm 2026-03-05 02:18:40,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:18:40,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:18:40,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8e43c911a9cbe7f77e5bb/log.txt.gz 2026-03-05 02:18:40,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:18:41,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:18:41,265 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8e43c911a9cbe7f77e5bb/lava-logs.yaml 2026-03-05 02:18:41,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:18:41,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:18:41,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8e43c911a9cbe7f77e5bb/lava_callback.json.gz DEBUG: Setup failed for 69a8e43c911a9cbe7f77e5bb. Transitting job node result: incomplete -> fail 2026-03-05 02:18:41,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:18:41,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e43c911a9cbe7f77e5bb HTTP/1.1" 200 None 2026-03-05 02:18:41,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:18:41,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 02:18:41,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:18:41,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e43c911a9cbe7f77e5bb HTTP/1.1" 200 None 2026-03-05 02:18:41,779 - lava_callback - INFO - Completed processing callback for node 69a8e43c911a9cbe7f77e5bb INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:18:53,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:18:53,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:21:07,427 - lava_callback - INFO - Received callback for node 69a8e773911a9cbe7f77e91c INFO: 172.21.0.1:40234 - "POST /node/69a8e773911a9cbe7f77e91c HTTP/1.0" 202 Accepted 2026-03-05 02:21:07,436 - lava_callback - INFO - Starting async job submit for node 69a8e773911a9cbe7f77e91c 2026-03-05 02:21:07,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:21:07,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e773911a9cbe7f77e91c HTTP/1.1" 200 None 2026-03-05 02:21:07,500 - lava_callback - DEBUG - Processing node 69a8e773911a9cbe7f77e91c: baseline-arm64-foundriesio 2026-03-05 02:21:08,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:21:08,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:21:08,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8e773911a9cbe7f77e91c/log.txt.gz 2026-03-05 02:21:09,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:21:09,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:21:09,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8e773911a9cbe7f77e91c/lava-logs.yaml 2026-03-05 02:21:09,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:21:09,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:21:09,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8e773911a9cbe7f77e91c/lava_callback.json.gz DEBUG: 69a8e773911a9cbe7f77e91c Transitting job node result: pass -> incomplete 2026-03-05 02:21:10,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:21:10,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e773911a9cbe7f77e91c HTTP/1.1" 200 None 2026-03-05 02:21:10,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:21:10,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:21:10,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:21:10,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e773911a9cbe7f77e91c HTTP/1.1" 200 None 2026-03-05 02:21:10,096 - lava_callback - INFO - Completed processing callback for node 69a8e773911a9cbe7f77e91c INFO: 172.21.0.1:45274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:21:23,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:21:23,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:26:58,581 - lava_callback - INFO - Received callback for node 69a8e9df911a9cbe7f77ebbf INFO: 172.21.0.1:33448 - "POST /node/69a8e9df911a9cbe7f77ebbf HTTP/1.0" 202 Accepted 2026-03-05 02:26:58,588 - lava_callback - INFO - Starting async job submit for node 69a8e9df911a9cbe7f77ebbf 2026-03-05 02:26:58,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:26:58,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e9df911a9cbe7f77ebbf HTTP/1.1" 200 None 2026-03-05 02:26:58,606 - lava_callback - DEBUG - Processing node 69a8e9df911a9cbe7f77ebbf: baseline-nfs-arm64 2026-03-05 02:26:58,608 - lava_callback - WARNING - Failed to upload log 2026-03-05 02:26:58,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:26:58,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:26:58,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e9df911a9cbe7f77ebbf/lava-logs.yaml 2026-03-05 02:26:58,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:26:58,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:26:58,914 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e9df911a9cbe7f77ebbf/lava_callback.json.gz 2026-03-05 02:26:58,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:26:58,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e9df911a9cbe7f77ebbf HTTP/1.1" 200 None 2026-03-05 02:26:58,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:26:58,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:26:58,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:26:58,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e9df911a9cbe7f77ebbf HTTP/1.1" 200 None 2026-03-05 02:26:58,972 - lava_callback - INFO - Completed processing callback for node 69a8e9df911a9cbe7f77ebbf INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:27:23,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:23,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 02:27:25,765 - lava_callback - INFO - Received callback for node 69a8e83c911a9cbe7f77ea0c INFO: 172.21.0.1:45942 - "POST /node/69a8e83c911a9cbe7f77ea0c HTTP/1.0" 202 Accepted 2026-03-05 02:27:25,773 - lava_callback - INFO - Starting async job submit for node 69a8e83c911a9cbe7f77ea0c 2026-03-05 02:27:25,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:25,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e83c911a9cbe7f77ea0c HTTP/1.1" 200 None 2026-03-05 02:27:25,830 - lava_callback - DEBUG - Processing node 69a8e83c911a9cbe7f77ea0c: baseline-arm64 2026-03-05 02:27:26,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:27:27,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:27:27,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8e83c911a9cbe7f77ea0c/log.txt.gz 2026-03-05 02:27:27,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:27:27,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:27:27,795 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8e83c911a9cbe7f77ea0c/lava-logs.yaml 2026-03-05 02:27:27,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:27:27,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:27:27,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8e83c911a9cbe7f77ea0c/lava_callback.json.gz DEBUG: Setup failed for 69a8e83c911a9cbe7f77ea0c. Transitting job node result: incomplete -> fail 2026-03-05 02:27:28,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:28,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e83c911a9cbe7f77ea0c HTTP/1.1" 200 None 2026-03-05 02:27:28,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:28,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:27:28,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:28,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e83c911a9cbe7f77ea0c HTTP/1.1" 200 None 2026-03-05 02:27:28,222 - lava_callback - INFO - Completed processing callback for node 69a8e83c911a9cbe7f77ea0c INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:27:52,417 - lava_callback - INFO - Received callback for node 69a8e5a5911a9cbe7f77e70e INFO: 172.21.0.1:36650 - "POST /node/69a8e5a5911a9cbe7f77e70e HTTP/1.0" 202 Accepted 2026-03-05 02:27:52,423 - lava_callback - INFO - Starting async job submit for node 69a8e5a5911a9cbe7f77e70e 2026-03-05 02:27:52,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:52,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e5a5911a9cbe7f77e70e HTTP/1.1" 200 None 2026-03-05 02:27:52,468 - lava_callback - DEBUG - Processing node 69a8e5a5911a9cbe7f77e70e: baseline-arm-clabbe 2026-03-05 02:27:52,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:27:52,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:27:52,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8e5a5911a9cbe7f77e70e/log.txt.gz 2026-03-05 02:27:52,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:27:53,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:27:53,128 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8e5a5911a9cbe7f77e70e/lava-logs.yaml 2026-03-05 02:27:53,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:27:53,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:27:53,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8e5a5911a9cbe7f77e70e/lava_callback.json.gz DEBUG: Setup failed for 69a8e5a5911a9cbe7f77e70e. Transitting job node result: incomplete -> fail 2026-03-05 02:27:53,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:53,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e5a5911a9cbe7f77e70e HTTP/1.1" 200 None 2026-03-05 02:27:53,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:53,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 02:27:53,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:53,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e5a5911a9cbe7f77e70e HTTP/1.1" 200 None 2026-03-05 02:27:53,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:27:53,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 02:27:53,503 - lava_callback - INFO - Completed processing callback for node 69a8e5a5911a9cbe7f77e70e INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:28:23,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:28:23,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:28:47,257 - lava_callback - INFO - Received callback for node 69a8e5d8911a9cbe7f77e738 INFO: 172.21.0.1:58372 - "POST /node/69a8e5d8911a9cbe7f77e738 HTTP/1.0" 202 Accepted 2026-03-05 02:28:47,308 - lava_callback - INFO - Starting async job submit for node 69a8e5d8911a9cbe7f77e738 2026-03-05 02:28:47,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:28:47,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e5d8911a9cbe7f77e738 HTTP/1.1" 200 None 2026-03-05 02:28:47,374 - lava_callback - DEBUG - Processing node 69a8e5d8911a9cbe7f77e738: baseline-arm-pengutronix 2026-03-05 02:28:47,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:28:47,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:28:47,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8e5d8911a9cbe7f77e738/log.txt.gz 2026-03-05 02:28:47,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:28:47,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:28:47,910 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8e5d8911a9cbe7f77e738/lava-logs.yaml 2026-03-05 02:28:47,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:28:48,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:28:48,030 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8e5d8911a9cbe7f77e738/lava_callback.json.gz DEBUG: Setup failed for 69a8e5d8911a9cbe7f77e738. Transitting job node result: incomplete -> fail 2026-03-05 02:28:48,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:28:48,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e5d8911a9cbe7f77e738 HTTP/1.1" 200 None 2026-03-05 02:28:48,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:28:48,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 02:28:48,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:28:48,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e5d8911a9cbe7f77e738 HTTP/1.1" 200 None 2026-03-05 02:28:48,198 - lava_callback - INFO - Completed processing callback for node 69a8e5d8911a9cbe7f77e738 2026-03-05 02:28:53,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:28:53,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:31:07,963 - lava_callback - INFO - Received callback for node 69a8eab4911a9cbe7f77ec89 INFO: 172.21.0.1:41068 - "POST /node/69a8eab4911a9cbe7f77ec89 HTTP/1.0" 202 Accepted 2026-03-05 02:31:07,970 - lava_callback - INFO - Starting async job submit for node 69a8eab4911a9cbe7f77ec89 2026-03-05 02:31:08,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:08,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8eab4911a9cbe7f77ec89 HTTP/1.1" 200 None 2026-03-05 02:31:08,018 - lava_callback - DEBUG - Processing node 69a8eab4911a9cbe7f77ec89: baseline-arm64 2026-03-05 02:31:08,149 - lava_callback - WARNING - Failed to upload log 2026-03-05 02:31:08,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:31:08,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:31:08,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8eab4911a9cbe7f77ec89/lava-logs.yaml 2026-03-05 02:31:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:31:08,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:31:08,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8eab4911a9cbe7f77ec89/lava_callback.json.gz 2026-03-05 02:31:08,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:08,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8eab4911a9cbe7f77ec89 HTTP/1.1" 200 None 2026-03-05 02:31:08,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:08,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:31:08,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:08,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8eab4911a9cbe7f77ec89 HTTP/1.1" 200 None 2026-03-05 02:31:08,750 - lava_callback - INFO - Completed processing callback for node 69a8eab4911a9cbe7f77ec89 INFO: 172.21.0.1:52440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:31:23,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:23,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:31:53,073 - lava_callback - INFO - Received callback for node 69a648137da105ad0983715a INFO: 172.21.0.1:45324 - "POST /node/69a648137da105ad0983715a HTTP/1.0" 202 Accepted 2026-03-05 02:31:53,079 - lava_callback - INFO - Starting async job submit for node 69a648137da105ad0983715a 2026-03-05 02:31:53,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:53,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a648137da105ad0983715a HTTP/1.1" 200 None 2026-03-05 02:31:53,094 - lava_callback - DEBUG - Processing node 69a648137da105ad0983715a: baseline-x86 2026-03-05 02:31:53,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a648137da105ad0983715a 2026-03-05 02:31:53,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:53,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a648137da105ad0983715a HTTP/1.1" 200 None 2026-03-05 02:31:53,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:53,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e11c32aaccb4c112ebb9 HTTP/1.1" 200 None 2026-03-05 02:31:53,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:53,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a648137da105ad0983715a HTTP/1.1" 200 None 2026-03-05 02:31:53,145 - lava_callback - ERROR - Error processing callback for node 69a648137da105ad0983715a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 02:31:56,480 - lava_callback - INFO - Received callback for node 69a8eb07911a9cbe7f77ecc7 INFO: 172.21.0.1:45338 - "POST /node/69a8eb07911a9cbe7f77ecc7 HTTP/1.0" 202 Accepted 2026-03-05 02:31:56,486 - lava_callback - INFO - Starting async job submit for node 69a8eb07911a9cbe7f77ecc7 2026-03-05 02:31:56,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:56,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8eb07911a9cbe7f77ecc7 HTTP/1.1" 200 None 2026-03-05 02:31:56,510 - lava_callback - DEBUG - Processing node 69a8eb07911a9cbe7f77ecc7: baseline-arm 2026-03-05 02:31:56,516 - lava_callback - WARNING - Failed to upload log INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:31:56,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:31:56,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:31:56,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8eb07911a9cbe7f77ecc7/lava-logs.yaml 2026-03-05 02:31:56,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:31:56,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:31:56,772 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8eb07911a9cbe7f77ecc7/lava_callback.json.gz 2026-03-05 02:31:56,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:56,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8eb07911a9cbe7f77ecc7 HTTP/1.1" 200 None 2026-03-05 02:31:56,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:56,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 02:31:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:31:56,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8eb07911a9cbe7f77ecc7 HTTP/1.1" 200 None 2026-03-05 02:31:56,832 - lava_callback - INFO - Completed processing callback for node 69a8eb07911a9cbe7f77ecc7 INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:32:23,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:32:23,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45284 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:38:02,926 - lava_callback - INFO - Received callback for node 69a649827da105ad098371e4 INFO: 172.21.0.1:55306 - "POST /node/69a649827da105ad098371e4 HTTP/1.0" 202 Accepted 2026-03-05 02:38:02,931 - lava_callback - INFO - Starting async job submit for node 69a649827da105ad098371e4 2026-03-05 02:38:02,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:38:02,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a649827da105ad098371e4 HTTP/1.1" 200 None 2026-03-05 02:38:02,948 - lava_callback - DEBUG - Processing node 69a649827da105ad098371e4: baseline-arm64-baylibre 2026-03-05 02:38:02,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a649827da105ad098371e4 2026-03-05 02:38:02,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:38:02,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a649827da105ad098371e4 HTTP/1.1" 200 None 2026-03-05 02:38:02,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:38:03,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-05 02:38:03,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:38:03,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a649827da105ad098371e4 HTTP/1.1" 200 None 2026-03-05 02:38:03,033 - lava_callback - ERROR - Error processing callback for node 69a649827da105ad098371e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:39:42,970 - lava_callback - INFO - Received callback for node 69a649db7da105ad09837200 INFO: 172.21.0.1:49562 - "POST /node/69a649db7da105ad09837200 HTTP/1.0" 202 Accepted 2026-03-05 02:39:42,980 - lava_callback - INFO - Starting async job submit for node 69a649db7da105ad09837200 2026-03-05 02:39:42,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:39:43,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a649db7da105ad09837200 HTTP/1.1" 200 None 2026-03-05 02:39:43,003 - lava_callback - DEBUG - Processing node 69a649db7da105ad09837200: baseline-arm64-baylibre 2026-03-05 02:39:43,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a649db7da105ad09837200 2026-03-05 02:39:43,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:39:43,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a649db7da105ad09837200 HTTP/1.1" 200 None 2026-03-05 02:39:43,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:39:43,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-05 02:39:43,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:39:43,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a649db7da105ad09837200 HTTP/1.1" 200 None 2026-03-05 02:39:43,088 - lava_callback - ERROR - Error processing callback for node 69a649db7da105ad09837200: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:40:34,473 - lava_callback - INFO - Received callback for node 69a8e4a1911a9cbe7f77e63a INFO: 172.21.0.1:51494 - "POST /node/69a8e4a1911a9cbe7f77e63a HTTP/1.0" 202 Accepted 2026-03-05 02:40:34,482 - lava_callback - INFO - Starting async job submit for node 69a8e4a1911a9cbe7f77e63a 2026-03-05 02:40:34,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:40:34,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e4a1911a9cbe7f77e63a HTTP/1.1" 200 None 2026-03-05 02:40:34,546 - lava_callback - DEBUG - Processing node 69a8e4a1911a9cbe7f77e63a: baseline-nfs-arm64 2026-03-05 02:40:35,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:40:35,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:40:35,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e4a1911a9cbe7f77e63a/log.txt.gz INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:40:36,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:40:37,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:40:37,017 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e4a1911a9cbe7f77e63a/lava-logs.yaml 2026-03-05 02:40:37,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:40:37,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:40:37,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8e4a1911a9cbe7f77e63a/lava_callback.json.gz DEBUG: Setup failed for 69a8e4a1911a9cbe7f77e63a. Transitting job node result: incomplete -> fail 2026-03-05 02:40:37,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:40:37,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e4a1911a9cbe7f77e63a HTTP/1.1" 200 None 2026-03-05 02:40:37,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:40:37,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:40:37,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:40:37,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e4a1911a9cbe7f77e63a HTTP/1.1" 200 None 2026-03-05 02:40:37,487 - lava_callback - INFO - Completed processing callback for node 69a8e4a1911a9cbe7f77e63a INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:40:53,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:40:53,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:41:03,050 - lava_callback - INFO - Received callback for node 69a64a327da105ad0983721e INFO: 172.21.0.1:55934 - "POST /node/69a64a327da105ad0983721e HTTP/1.0" 202 Accepted 2026-03-05 02:41:03,055 - lava_callback - INFO - Starting async job submit for node 69a64a327da105ad0983721e 2026-03-05 02:41:03,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:41:03,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64a327da105ad0983721e HTTP/1.1" 200 None 2026-03-05 02:41:03,071 - lava_callback - DEBUG - Processing node 69a64a327da105ad0983721e: baseline-arm64-baylibre 2026-03-05 02:41:03,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64a327da105ad0983721e 2026-03-05 02:41:03,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:41:03,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64a327da105ad0983721e HTTP/1.1" 200 None 2026-03-05 02:41:03,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:41:03,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-05 02:41:03,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:41:03,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64a327da105ad0983721e HTTP/1.1" 200 None 2026-03-05 02:41:03,126 - lava_callback - ERROR - Error processing callback for node 69a64a327da105ad0983721e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:42:23,120 - lava_callback - INFO - Received callback for node 69a64a897da105ad09837239 INFO: 172.21.0.1:33674 - "POST /node/69a64a897da105ad09837239 HTTP/1.0" 202 Accepted 2026-03-05 02:42:23,125 - lava_callback - INFO - Starting async job submit for node 69a64a897da105ad09837239 2026-03-05 02:42:23,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:23,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64a897da105ad09837239 HTTP/1.1" 200 None 2026-03-05 02:42:23,142 - lava_callback - DEBUG - Processing node 69a64a897da105ad09837239: baseline-arm64-baylibre 2026-03-05 02:42:23,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64a897da105ad09837239 2026-03-05 02:42:23,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:23,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64a897da105ad09837239 HTTP/1.1" 200 None 2026-03-05 02:42:23,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:23,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-05 02:42:23,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:23,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64a897da105ad09837239 HTTP/1.1" 200 None 2026-03-05 02:42:23,201 - lava_callback - ERROR - Error processing callback for node 69a64a897da105ad09837239: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:42:34,075 - lava_callback - INFO - Received callback for node 69a8ed39911a9cbe7f77eeff INFO: 172.21.0.1:38520 - "POST /node/69a8ed39911a9cbe7f77eeff HTTP/1.0" 202 Accepted 2026-03-05 02:42:34,082 - lava_callback - INFO - Starting async job submit for node 69a8ed39911a9cbe7f77eeff 2026-03-05 02:42:34,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:34,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ed39911a9cbe7f77eeff HTTP/1.1" 200 None 2026-03-05 02:42:34,127 - lava_callback - DEBUG - Processing node 69a8ed39911a9cbe7f77eeff: baseline-arm64 2026-03-05 02:42:34,342 - lava_callback - WARNING - Failed to upload log 2026-03-05 02:42:34,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:42:34,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:42:34,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8ed39911a9cbe7f77eeff/lava-logs.yaml 2026-03-05 02:42:34,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:42:34,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:42:34,825 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8ed39911a9cbe7f77eeff/lava_callback.json.gz 2026-03-05 02:42:34,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:34,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ed39911a9cbe7f77eeff HTTP/1.1" 200 None 2026-03-05 02:42:34,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:34,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:42:34,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:34,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ed39911a9cbe7f77eeff HTTP/1.1" 200 None 2026-03-05 02:42:35,008 - lava_callback - INFO - Completed processing callback for node 69a8ed39911a9cbe7f77eeff INFO: 172.21.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58484 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:42:53,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:42:53,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:44:03,209 - lava_callback - INFO - Received callback for node 69a64ae07da105ad0983724f INFO: 172.21.0.1:46848 - "POST /node/69a64ae07da105ad0983724f HTTP/1.0" 202 Accepted 2026-03-05 02:44:03,215 - lava_callback - INFO - Starting async job submit for node 69a64ae07da105ad0983724f 2026-03-05 02:44:03,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:44:03,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64ae07da105ad0983724f HTTP/1.1" 200 None 2026-03-05 02:44:03,237 - lava_callback - DEBUG - Processing node 69a64ae07da105ad0983724f: baseline-arm64-baylibre 2026-03-05 02:44:03,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64ae07da105ad0983724f 2026-03-05 02:44:03,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:44:03,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64ae07da105ad0983724f HTTP/1.1" 200 None 2026-03-05 02:44:03,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:44:03,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-05 02:44:03,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:44:03,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64ae07da105ad0983724f HTTP/1.1" 200 None 2026-03-05 02:44:03,297 - lava_callback - ERROR - Error processing callback for node 69a64ae07da105ad0983724f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:45:23,409 - lava_callback - INFO - Received callback for node 69a64b347da105ad0983725c INFO: 172.21.0.1:57814 - "POST /node/69a64b347da105ad0983725c HTTP/1.0" 202 Accepted 2026-03-05 02:45:23,418 - lava_callback - INFO - Starting async job submit for node 69a64b347da105ad0983725c 2026-03-05 02:45:23,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:45:23,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64b347da105ad0983725c HTTP/1.1" 200 None 2026-03-05 02:45:23,452 - lava_callback - DEBUG - Processing node 69a64b347da105ad0983725c: baseline-arm64-baylibre 2026-03-05 02:45:23,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64b347da105ad0983725c 2026-03-05 02:45:23,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:45:23,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64b347da105ad0983725c HTTP/1.1" 200 None 2026-03-05 02:45:23,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:45:23,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-05 02:45:23,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:45:23,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64b347da105ad0983725c HTTP/1.1" 200 None 2026-03-05 02:45:23,556 - lava_callback - ERROR - Error processing callback for node 69a64b347da105ad0983725c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:55:59,086 - lava_callback - INFO - Received callback for node 69a8ef6b911a9cbe7f77f178 INFO: 172.21.0.1:32898 - "POST /node/69a8ef6b911a9cbe7f77f178 HTTP/1.0" 202 Accepted 2026-03-05 02:55:59,096 - lava_callback - INFO - Starting async job submit for node 69a8ef6b911a9cbe7f77f178 2026-03-05 02:55:59,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:55:59,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ef6b911a9cbe7f77f178 HTTP/1.1" 200 None 2026-03-05 02:55:59,166 - lava_callback - DEBUG - Processing node 69a8ef6b911a9cbe7f77f178: baseline-arm64-foundriesio 2026-03-05 02:56:00,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:56:00,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:56:00,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8ef6b911a9cbe7f77f178/log.txt.gz 2026-03-05 02:56:01,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:56:01,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:56:01,575 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8ef6b911a9cbe7f77f178/lava-logs.yaml 2026-03-05 02:56:01,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:56:01,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:56:01,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69a8ef6b911a9cbe7f77f178/lava_callback.json.gz DEBUG: Setup failed for 69a8ef6b911a9cbe7f77f178. Transitting job node result: incomplete -> fail 2026-03-05 02:56:02,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:56:02,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ef6b911a9cbe7f77f178 HTTP/1.1" 200 None 2026-03-05 02:56:02,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:56:02,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:56:02,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:56:02,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ef6b911a9cbe7f77f178 HTTP/1.1" 200 None 2026-03-05 02:56:02,251 - lava_callback - INFO - Completed processing callback for node 69a8ef6b911a9cbe7f77f178 INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:56:23,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:56:23,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:57:03,954 - lava_callback - INFO - Received callback for node 69a64def7da105ad0983738b INFO: 172.21.0.1:59098 - "POST /node/69a64def7da105ad0983738b HTTP/1.0" 202 Accepted 2026-03-05 02:57:03,960 - lava_callback - INFO - Starting async job submit for node 69a64def7da105ad0983738b 2026-03-05 02:57:03,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:57:03,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64def7da105ad0983738b HTTP/1.1" 200 None 2026-03-05 02:57:03,976 - lava_callback - DEBUG - Processing node 69a64def7da105ad0983738b: baseline-arm-baylibre 2026-03-05 02:57:03,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64def7da105ad0983738b 2026-03-05 02:57:03,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:57:03,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64def7da105ad0983738b HTTP/1.1" 200 None 2026-03-05 02:57:03,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:57:04,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 02:57:04,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:57:04,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64def7da105ad0983738b HTTP/1.1" 200 None 2026-03-05 02:57:04,074 - lava_callback - ERROR - Error processing callback for node 69a64def7da105ad0983738b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:57:43,929 - lava_callback - INFO - Received callback for node 69a64e227da105ad098373a3 INFO: 172.21.0.1:45036 - "POST /node/69a64e227da105ad098373a3 HTTP/1.0" 202 Accepted 2026-03-05 02:57:43,934 - lava_callback - INFO - Starting async job submit for node 69a64e227da105ad098373a3 2026-03-05 02:57:43,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:57:43,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64e227da105ad098373a3 HTTP/1.1" 200 None 2026-03-05 02:57:43,949 - lava_callback - DEBUG - Processing node 69a64e227da105ad098373a3: baseline-arm-baylibre 2026-03-05 02:57:43,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64e227da105ad098373a3 2026-03-05 02:57:43,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:57:43,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64e227da105ad098373a3 HTTP/1.1" 200 None 2026-03-05 02:57:43,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:57:43,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 02:57:43,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:57:44,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64e227da105ad098373a3 HTTP/1.1" 200 None 2026-03-05 02:57:44,009 - lava_callback - ERROR - Error processing callback for node 69a64e227da105ad098373a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:58:44,042 - lava_callback - INFO - Received callback for node 69a64e527da105ad098373df INFO: 172.21.0.1:50550 - "POST /node/69a64e527da105ad098373df HTTP/1.0" 202 Accepted 2026-03-05 02:58:44,048 - lava_callback - INFO - Starting async job submit for node 69a64e527da105ad098373df 2026-03-05 02:58:44,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:44,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64e527da105ad098373df HTTP/1.1" 200 None 2026-03-05 02:58:44,064 - lava_callback - DEBUG - Processing node 69a64e527da105ad098373df: baseline-arm-baylibre 2026-03-05 02:58:44,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64e527da105ad098373df 2026-03-05 02:58:44,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:44,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64e527da105ad098373df HTTP/1.1" 200 None 2026-03-05 02:58:44,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:44,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 02:58:44,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:44,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64e527da105ad098373df HTTP/1.1" 200 None 2026-03-05 02:58:44,120 - lava_callback - ERROR - Error processing callback for node 69a64e527da105ad098373df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-05 02:58:46,031 - lava_callback - INFO - Received callback for node 69a8efab911a9cbe7f77f1b1 INFO: 172.21.0.1:50552 - "POST /node/69a8efab911a9cbe7f77f1b1 HTTP/1.0" 202 Accepted 2026-03-05 02:58:46,038 - lava_callback - INFO - Starting async job submit for node 69a8efab911a9cbe7f77f1b1 2026-03-05 02:58:46,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:46,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8efab911a9cbe7f77f1b1 HTTP/1.1" 200 None 2026-03-05 02:58:46,096 - lava_callback - DEBUG - Processing node 69a8efab911a9cbe7f77f1b1: baseline-arm64 2026-03-05 02:58:46,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:58:46,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:58:46,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8efab911a9cbe7f77f1b1/log.txt.gz 2026-03-05 02:58:46,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:58:47,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:58:47,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8efab911a9cbe7f77f1b1/lava-logs.yaml 2026-03-05 02:58:47,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 02:58:47,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 02:58:47,323 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69a8efab911a9cbe7f77f1b1/lava_callback.json.gz DEBUG: Setup failed for 69a8efab911a9cbe7f77f1b1. Transitting job node result: incomplete -> fail 2026-03-05 02:58:47,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:47,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8efab911a9cbe7f77f1b1 HTTP/1.1" 200 None 2026-03-05 02:58:47,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:47,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 02:58:47,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:47,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8efab911a9cbe7f77f1b1 HTTP/1.1" 200 None 2026-03-05 02:58:47,558 - lava_callback - INFO - Completed processing callback for node 69a8efab911a9cbe7f77f1b1 2026-03-05 02:58:53,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:58:53,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK 2026-03-05 02:59:24,040 - lava_callback - INFO - Received callback for node 69a64e847da105ad0983741c INFO: 172.21.0.1:52248 - "POST /node/69a64e847da105ad0983741c HTTP/1.0" 202 Accepted 2026-03-05 02:59:24,046 - lava_callback - INFO - Starting async job submit for node 69a64e847da105ad0983741c 2026-03-05 02:59:24,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:59:24,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64e847da105ad0983741c HTTP/1.1" 200 None 2026-03-05 02:59:24,068 - lava_callback - DEBUG - Processing node 69a64e847da105ad0983741c: baseline-arm-baylibre 2026-03-05 02:59:24,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64e847da105ad0983741c 2026-03-05 02:59:24,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:59:24,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64e847da105ad0983741c HTTP/1.1" 200 None 2026-03-05 02:59:24,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:59:24,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 02:59:24,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 02:59:24,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64e847da105ad0983741c HTTP/1.1" 200 None 2026-03-05 02:59:24,125 - lava_callback - ERROR - Error processing callback for node 69a64e847da105ad0983741c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:00:24,157 - lava_callback - INFO - Received callback for node 69a64eb67da105ad09837437 INFO: 172.21.0.1:43298 - "POST /node/69a64eb67da105ad09837437 HTTP/1.0" 202 Accepted 2026-03-05 03:00:24,166 - lava_callback - INFO - Starting async job submit for node 69a64eb67da105ad09837437 2026-03-05 03:00:24,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:00:24,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64eb67da105ad09837437 HTTP/1.1" 200 None 2026-03-05 03:00:24,188 - lava_callback - DEBUG - Processing node 69a64eb67da105ad09837437: baseline-arm-baylibre 2026-03-05 03:00:24,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64eb67da105ad09837437 2026-03-05 03:00:24,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:00:24,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64eb67da105ad09837437 HTTP/1.1" 200 None 2026-03-05 03:00:24,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:00:24,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 03:00:24,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:00:24,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64eb67da105ad09837437 HTTP/1.1" 200 None 2026-03-05 03:00:24,246 - lava_callback - ERROR - Error processing callback for node 69a64eb67da105ad09837437: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:01:04,126 - lava_callback - INFO - Received callback for node 69a64ee97da105ad0983746f INFO: 172.21.0.1:52398 - "POST /node/69a64ee97da105ad0983746f HTTP/1.0" 202 Accepted 2026-03-05 03:01:04,132 - lava_callback - INFO - Starting async job submit for node 69a64ee97da105ad0983746f 2026-03-05 03:01:04,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:01:04,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64ee97da105ad0983746f HTTP/1.1" 200 None 2026-03-05 03:01:04,149 - lava_callback - DEBUG - Processing node 69a64ee97da105ad0983746f: baseline-arm-baylibre 2026-03-05 03:01:04,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a64ee97da105ad0983746f 2026-03-05 03:01:04,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:01:04,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a64ee97da105ad0983746f HTTP/1.1" 200 None 2026-03-05 03:01:04,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:01:04,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 03:01:04,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:01:04,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a64ee97da105ad0983746f HTTP/1.1" 200 None 2026-03-05 03:01:04,209 - lava_callback - ERROR - Error processing callback for node 69a64ee97da105ad0983746f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:05:46,316 - lava_callback - INFO - Received callback for node 69a8ef23911a9cbe7f77f128 INFO: 172.21.0.1:45248 - "POST /node/69a8ef23911a9cbe7f77f128 HTTP/1.0" 202 Accepted 2026-03-05 03:05:46,323 - lava_callback - INFO - Starting async job submit for node 69a8ef23911a9cbe7f77f128 2026-03-05 03:05:46,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:05:46,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ef23911a9cbe7f77f128 HTTP/1.1" 200 None 2026-03-05 03:05:46,394 - lava_callback - DEBUG - Processing node 69a8ef23911a9cbe7f77f128: baseline-arm INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:05:47,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:05:47,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:05:47,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8ef23911a9cbe7f77f128/log.txt.gz 2026-03-05 03:05:47,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:05:47,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:05:47,851 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8ef23911a9cbe7f77f128/lava-logs.yaml 2026-03-05 03:05:47,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:05:48,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:05:48,007 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8ef23911a9cbe7f77f128/lava_callback.json.gz DEBUG: Setup failed for 69a8ef23911a9cbe7f77f128. Transitting job node result: incomplete -> fail 2026-03-05 03:05:48,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:05:48,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ef23911a9cbe7f77f128 HTTP/1.1" 200 None 2026-03-05 03:05:48,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:05:48,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 03:05:48,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:05:48,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ef23911a9cbe7f77f128 HTTP/1.1" 200 None 2026-03-05 03:05:48,279 - lava_callback - INFO - Completed processing callback for node 69a8ef23911a9cbe7f77f128 2026-03-05 03:05:53,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:05:53,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:10:54,891 - lava_callback - INFO - Received callback for node 69a651317da105ad09837553 INFO: 172.21.0.1:42488 - "POST /node/69a651317da105ad09837553 HTTP/1.0" 202 Accepted 2026-03-05 03:10:54,896 - lava_callback - INFO - Starting async job submit for node 69a651317da105ad09837553 2026-03-05 03:10:54,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:10:54,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a651317da105ad09837553 HTTP/1.1" 200 None 2026-03-05 03:10:54,912 - lava_callback - DEBUG - Processing node 69a651317da105ad09837553: baseline-x86 2026-03-05 03:10:54,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a651317da105ad09837553 2026-03-05 03:10:54,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:10:54,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a651317da105ad09837553 HTTP/1.1" 200 None 2026-03-05 03:10:54,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:10:54,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a547ac2f71ebbe58f1bc90 HTTP/1.1" 200 None 2026-03-05 03:10:54,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:10:54,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a651317da105ad09837553 HTTP/1.1" 200 None 2026-03-05 03:10:54,972 - lava_callback - ERROR - Error processing callback for node 69a651317da105ad09837553: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:12:13,637 - lava_callback - INFO - Received callback for node 69a8f005911a9cbe7f77f1eb INFO: 172.21.0.1:51738 - "POST /node/69a8f005911a9cbe7f77f1eb HTTP/1.0" 202 Accepted 2026-03-05 03:12:13,643 - lava_callback - INFO - Starting async job submit for node 69a8f005911a9cbe7f77f1eb 2026-03-05 03:12:13,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:13,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f005911a9cbe7f77f1eb HTTP/1.1" 200 None 2026-03-05 03:12:13,693 - lava_callback - DEBUG - Processing node 69a8f005911a9cbe7f77f1eb: baseline-arm-clabbe 2026-03-05 03:12:13,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:12:14,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:12:14,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8f005911a9cbe7f77f1eb/log.txt.gz 2026-03-05 03:12:14,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:12:14,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:12:14,374 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8f005911a9cbe7f77f1eb/lava-logs.yaml 2026-03-05 03:12:14,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:12:14,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:12:14,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8f005911a9cbe7f77f1eb/lava_callback.json.gz DEBUG: Setup failed for 69a8f005911a9cbe7f77f1eb. Transitting job node result: incomplete -> fail 2026-03-05 03:12:14,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:14,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f005911a9cbe7f77f1eb HTTP/1.1" 200 None 2026-03-05 03:12:14,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:14,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 03:12:14,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:14,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f005911a9cbe7f77f1eb HTTP/1.1" 200 None 2026-03-05 03:12:14,720 - lava_callback - INFO - Completed processing callback for node 69a8f005911a9cbe7f77f1eb INFO: 172.21.0.1:51742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:12:23,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:23,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:12:44,748 - lava_callback - INFO - Received callback for node 69a6519a7da105ad098375a3 INFO: 172.21.0.1:34470 - "POST /node/69a6519a7da105ad098375a3 HTTP/1.0" 202 Accepted 2026-03-05 03:12:44,753 - lava_callback - INFO - Starting async job submit for node 69a6519a7da105ad098375a3 2026-03-05 03:12:44,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:44,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6519a7da105ad098375a3 HTTP/1.1" 200 None 2026-03-05 03:12:44,769 - lava_callback - DEBUG - Processing node 69a6519a7da105ad098375a3: baseline-arm-baylibre 2026-03-05 03:12:44,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6519a7da105ad098375a3 2026-03-05 03:12:44,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:44,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6519a7da105ad098375a3 HTTP/1.1" 200 None 2026-03-05 03:12:44,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:44,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-05 03:12:44,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:12:44,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6519a7da105ad098375a3 HTTP/1.1" 200 None 2026-03-05 03:12:44,821 - lava_callback - ERROR - Error processing callback for node 69a6519a7da105ad098375a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:13:10,060 - lava_callback - INFO - Received callback for node 69a8f036911a9cbe7f77f238 INFO: 172.21.0.1:49180 - "POST /node/69a8f036911a9cbe7f77f238 HTTP/1.0" 202 Accepted 2026-03-05 03:13:10,113 - lava_callback - INFO - Starting async job submit for node 69a8f036911a9cbe7f77f238 2026-03-05 03:13:10,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:10,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f036911a9cbe7f77f238 HTTP/1.1" 200 None 2026-03-05 03:13:10,153 - lava_callback - DEBUG - Processing node 69a8f036911a9cbe7f77f238: baseline-arm-pengutronix 2026-03-05 03:13:10,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:13:10,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:13:10,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8f036911a9cbe7f77f238/log.txt.gz 2026-03-05 03:13:10,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:13:10,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:13:10,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8f036911a9cbe7f77f238/lava-logs.yaml 2026-03-05 03:13:10,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:13:10,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:13:10,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8f036911a9cbe7f77f238/lava_callback.json.gz DEBUG: Setup failed for 69a8f036911a9cbe7f77f238. Transitting job node result: incomplete -> fail 2026-03-05 03:13:10,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:10,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f036911a9cbe7f77f238 HTTP/1.1" 200 None 2026-03-05 03:13:10,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:10,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 03:13:10,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:10,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f036911a9cbe7f77f238 HTTP/1.1" 200 None 2026-03-05 03:13:10,934 - lava_callback - INFO - Completed processing callback for node 69a8f036911a9cbe7f77f238 INFO: 172.21.0.1:49188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:13:23,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:23,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-05 03:13:24,734 - lava_callback - INFO - Received callback for node 69a651cc7da105ad098375de INFO: 172.21.0.1:41348 - "POST /node/69a651cc7da105ad098375de HTTP/1.0" 202 Accepted 2026-03-05 03:13:24,740 - lava_callback - INFO - Starting async job submit for node 69a651cc7da105ad098375de 2026-03-05 03:13:24,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:24,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a651cc7da105ad098375de HTTP/1.1" 200 None 2026-03-05 03:13:24,767 - lava_callback - DEBUG - Processing node 69a651cc7da105ad098375de: baseline-arm-baylibre 2026-03-05 03:13:24,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a651cc7da105ad098375de 2026-03-05 03:13:24,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:24,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a651cc7da105ad098375de HTTP/1.1" 200 None 2026-03-05 03:13:24,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:24,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-05 03:13:24,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:13:24,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a651cc7da105ad098375de HTTP/1.1" 200 None 2026-03-05 03:13:24,828 - lava_callback - ERROR - Error processing callback for node 69a651cc7da105ad098375de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:14:24,845 - lava_callback - INFO - Received callback for node 69a651fe7da105ad098375f4 INFO: 172.21.0.1:51812 - "POST /node/69a651fe7da105ad098375f4 HTTP/1.0" 202 Accepted 2026-03-05 03:14:24,850 - lava_callback - INFO - Starting async job submit for node 69a651fe7da105ad098375f4 2026-03-05 03:14:24,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:14:24,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a651fe7da105ad098375f4 HTTP/1.1" 200 None 2026-03-05 03:14:24,892 - lava_callback - DEBUG - Processing node 69a651fe7da105ad098375f4: baseline-arm-baylibre 2026-03-05 03:14:24,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a651fe7da105ad098375f4 2026-03-05 03:14:24,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:14:24,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a651fe7da105ad098375f4 HTTP/1.1" 200 None 2026-03-05 03:14:24,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:14:24,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-05 03:14:24,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:14:24,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a651fe7da105ad098375f4 HTTP/1.1" 200 None 2026-03-05 03:14:24,953 - lava_callback - ERROR - Error processing callback for node 69a651fe7da105ad098375f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:15:04,821 - lava_callback - INFO - Received callback for node 69a652327da105ad09837630 INFO: 172.21.0.1:52176 - "POST /node/69a652327da105ad09837630 HTTP/1.0" 202 Accepted 2026-03-05 03:15:04,830 - lava_callback - INFO - Starting async job submit for node 69a652327da105ad09837630 2026-03-05 03:15:04,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:15:04,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a652327da105ad09837630 HTTP/1.1" 200 None 2026-03-05 03:15:04,850 - lava_callback - DEBUG - Processing node 69a652327da105ad09837630: baseline-arm-baylibre 2026-03-05 03:15:04,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a652327da105ad09837630 2026-03-05 03:15:04,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:15:04,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a652327da105ad09837630 HTTP/1.1" 200 None 2026-03-05 03:15:04,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:15:04,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-05 03:15:04,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:15:04,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a652327da105ad09837630 HTTP/1.1" 200 None 2026-03-05 03:15:04,906 - lava_callback - ERROR - Error processing callback for node 69a652327da105ad09837630: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:16:05,023 - lava_callback - INFO - Received callback for node 69a652637da105ad09837678 INFO: 172.21.0.1:33868 - "POST /node/69a652637da105ad09837678 HTTP/1.0" 202 Accepted 2026-03-05 03:16:05,029 - lava_callback - INFO - Starting async job submit for node 69a652637da105ad09837678 2026-03-05 03:16:05,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:16:05,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a652637da105ad09837678 HTTP/1.1" 200 None 2026-03-05 03:16:05,052 - lava_callback - DEBUG - Processing node 69a652637da105ad09837678: baseline-arm-baylibre 2026-03-05 03:16:05,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a652637da105ad09837678 2026-03-05 03:16:05,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:16:05,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a652637da105ad09837678 HTTP/1.1" 200 None 2026-03-05 03:16:05,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:16:05,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-05 03:16:05,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:16:05,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a652637da105ad09837678 HTTP/1.1" 200 None 2026-03-05 03:16:05,113 - lava_callback - ERROR - Error processing callback for node 69a652637da105ad09837678: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:16:44,909 - lava_callback - INFO - Received callback for node 69a652967da105ad0983768e INFO: 172.21.0.1:38332 - "POST /node/69a652967da105ad0983768e HTTP/1.0" 202 Accepted 2026-03-05 03:16:44,914 - lava_callback - INFO - Starting async job submit for node 69a652967da105ad0983768e 2026-03-05 03:16:44,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:16:44,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a652967da105ad0983768e HTTP/1.1" 200 None 2026-03-05 03:16:44,930 - lava_callback - DEBUG - Processing node 69a652967da105ad0983768e: baseline-arm-baylibre 2026-03-05 03:16:44,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a652967da105ad0983768e 2026-03-05 03:16:44,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:16:44,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a652967da105ad0983768e HTTP/1.1" 200 None 2026-03-05 03:16:44,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:16:44,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5478e2f71ebbe58f1bc5c HTTP/1.1" 200 None 2026-03-05 03:16:44,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:16:44,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a652967da105ad0983768e HTTP/1.1" 200 None 2026-03-05 03:16:44,981 - lava_callback - ERROR - Error processing callback for node 69a652967da105ad0983768e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:20:27,991 - lava_callback - INFO - Received callback for node 69a8f1de911a9cbe7f77f3b8 INFO: 172.21.0.1:37220 - "POST /node/69a8f1de911a9cbe7f77f3b8 HTTP/1.0" 202 Accepted 2026-03-05 03:20:27,999 - lava_callback - INFO - Starting async job submit for node 69a8f1de911a9cbe7f77f3b8 2026-03-05 03:20:28,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:20:28,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f1de911a9cbe7f77f3b8 HTTP/1.1" 200 None 2026-03-05 03:20:28,074 - lava_callback - DEBUG - Processing node 69a8f1de911a9cbe7f77f3b8: baseline-nfs-arm64 2026-03-05 03:20:29,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:20:29,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:20:29,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8f1de911a9cbe7f77f3b8/log.txt.gz 2026-03-05 03:20:29,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:20:30,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:20:30,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8f1de911a9cbe7f77f3b8/lava-logs.yaml 2026-03-05 03:20:30,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:20:30,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:20:30,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8f1de911a9cbe7f77f3b8/lava_callback.json.gz DEBUG: Setup failed for 69a8f1de911a9cbe7f77f3b8. Transitting job node result: incomplete -> fail 2026-03-05 03:20:30,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:20:30,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f1de911a9cbe7f77f3b8 HTTP/1.1" 200 None 2026-03-05 03:20:30,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:20:30,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 03:20:30,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:20:30,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f1de911a9cbe7f77f3b8 HTTP/1.1" 200 None 2026-03-05 03:20:30,789 - lava_callback - INFO - Completed processing callback for node 69a8f1de911a9cbe7f77f3b8 INFO: 172.21.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:20:53,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:20:53,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:23:45,391 - lava_callback - INFO - Received callback for node 69a654367da105ad09837773 INFO: 172.21.0.1:45132 - "POST /node/69a654367da105ad09837773 HTTP/1.0" 202 Accepted 2026-03-05 03:23:45,397 - lava_callback - INFO - Starting async job submit for node 69a654367da105ad09837773 2026-03-05 03:23:45,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:23:45,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a654367da105ad09837773 HTTP/1.1" 200 None 2026-03-05 03:23:45,427 - lava_callback - DEBUG - Processing node 69a654367da105ad09837773: baseline-arm64-baylibre 2026-03-05 03:23:45,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a654367da105ad09837773 2026-03-05 03:23:45,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:23:45,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a654367da105ad09837773 HTTP/1.1" 200 None 2026-03-05 03:23:45,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:23:45,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-05 03:23:45,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:23:45,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a654367da105ad09837773 HTTP/1.1" 200 None 2026-03-05 03:23:45,484 - lava_callback - ERROR - Error processing callback for node 69a654367da105ad09837773: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:25:05,446 - lava_callback - INFO - Received callback for node 69a6548d7da105ad09837791 INFO: 172.21.0.1:40324 - "POST /node/69a6548d7da105ad09837791 HTTP/1.0" 202 Accepted 2026-03-05 03:25:05,452 - lava_callback - INFO - Starting async job submit for node 69a6548d7da105ad09837791 2026-03-05 03:25:05,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:25:05,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6548d7da105ad09837791 HTTP/1.1" 200 None 2026-03-05 03:25:05,468 - lava_callback - DEBUG - Processing node 69a6548d7da105ad09837791: baseline-arm64-baylibre 2026-03-05 03:25:05,469 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6548d7da105ad09837791 2026-03-05 03:25:05,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:25:05,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6548d7da105ad09837791 HTTP/1.1" 200 None 2026-03-05 03:25:05,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:25:05,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-05 03:25:05,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:25:05,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6548d7da105ad09837791 HTTP/1.1" 200 None 2026-03-05 03:25:05,538 - lava_callback - ERROR - Error processing callback for node 69a6548d7da105ad09837791: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:26:45,658 - lava_callback - INFO - Received callback for node 69a654e37da105ad098377ad INFO: 172.21.0.1:54856 - "POST /node/69a654e37da105ad098377ad HTTP/1.0" 202 Accepted 2026-03-05 03:26:45,663 - lava_callback - INFO - Starting async job submit for node 69a654e37da105ad098377ad 2026-03-05 03:26:45,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:26:45,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a654e37da105ad098377ad HTTP/1.1" 200 None 2026-03-05 03:26:45,703 - lava_callback - DEBUG - Processing node 69a654e37da105ad098377ad: baseline-arm64-baylibre 2026-03-05 03:26:45,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a654e37da105ad098377ad 2026-03-05 03:26:45,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:26:45,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a654e37da105ad098377ad HTTP/1.1" 200 None 2026-03-05 03:26:45,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:26:45,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-05 03:26:45,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:26:45,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a654e37da105ad098377ad HTTP/1.1" 200 None 2026-03-05 03:26:45,764 - lava_callback - ERROR - Error processing callback for node 69a654e37da105ad098377ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:28:05,602 - lava_callback - INFO - Received callback for node 69a6553c7da105ad098377c3 INFO: 172.21.0.1:59006 - "POST /node/69a6553c7da105ad098377c3 HTTP/1.0" 202 Accepted 2026-03-05 03:28:05,608 - lava_callback - INFO - Starting async job submit for node 69a6553c7da105ad098377c3 2026-03-05 03:28:05,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:05,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6553c7da105ad098377c3 HTTP/1.1" 200 None 2026-03-05 03:28:05,624 - lava_callback - DEBUG - Processing node 69a6553c7da105ad098377c3: baseline-arm64-baylibre 2026-03-05 03:28:05,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6553c7da105ad098377c3 2026-03-05 03:28:05,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:05,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6553c7da105ad098377c3 HTTP/1.1" 200 None 2026-03-05 03:28:05,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:05,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-05 03:28:05,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:05,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6553c7da105ad098377c3 HTTP/1.1" 200 None 2026-03-05 03:28:05,683 - lava_callback - ERROR - Error processing callback for node 69a6553c7da105ad098377c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:28:35,833 - lava_callback - INFO - Received callback for node 69a8ea2e911a9cbe7f77ebfc INFO: 172.21.0.1:45610 - "POST /node/69a8ea2e911a9cbe7f77ebfc HTTP/1.0" 202 Accepted 2026-03-05 03:28:35,840 - lava_callback - INFO - Starting async job submit for node 69a8ea2e911a9cbe7f77ebfc 2026-03-05 03:28:35,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:35,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ea2e911a9cbe7f77ebfc HTTP/1.1" 200 None 2026-03-05 03:28:35,913 - lava_callback - DEBUG - Processing node 69a8ea2e911a9cbe7f77ebfc: ltp-smoke 2026-03-05 03:28:36,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:28:36,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:28:36,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8ea2e911a9cbe7f77ebfc/log.txt.gz 2026-03-05 03:28:36,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:28:37,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:28:37,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8ea2e911a9cbe7f77ebfc/lava-logs.yaml 2026-03-05 03:28:37,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:28:37,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:28:37,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69a8ea2e911a9cbe7f77ebfc/lava_callback.json.gz 2026-03-05 03:28:37,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:37,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ea2e911a9cbe7f77ebfc HTTP/1.1" 200 None 2026-03-05 03:28:37,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:37,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbc3911a9cbe7f77ccb1 HTTP/1.1" 200 None 2026-03-05 03:28:37,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:37,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ea2e911a9cbe7f77ebfc HTTP/1.1" 200 None 2026-03-05 03:28:37,654 - lava_callback - INFO - Completed processing callback for node 69a8ea2e911a9cbe7f77ebfc INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:28:53,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:28:53,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:29:25,713 - lava_callback - INFO - Received callback for node 69a655937da105ad098377d9 INFO: 172.21.0.1:39368 - "POST /node/69a655937da105ad098377d9 HTTP/1.0" 202 Accepted 2026-03-05 03:29:25,719 - lava_callback - INFO - Starting async job submit for node 69a655937da105ad098377d9 2026-03-05 03:29:25,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:29:25,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a655937da105ad098377d9 HTTP/1.1" 200 None 2026-03-05 03:29:25,736 - lava_callback - DEBUG - Processing node 69a655937da105ad098377d9: baseline-arm64-baylibre 2026-03-05 03:29:25,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a655937da105ad098377d9 2026-03-05 03:29:25,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:29:25,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a655937da105ad098377d9 HTTP/1.1" 200 None 2026-03-05 03:29:25,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:29:25,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-05 03:29:25,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:29:25,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a655937da105ad098377d9 HTTP/1.1" 200 None 2026-03-05 03:29:25,801 - lava_callback - ERROR - Error processing callback for node 69a655937da105ad098377d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:31:05,846 - lava_callback - INFO - Received callback for node 69a655ea7da105ad098377ee INFO: 172.21.0.1:49414 - "POST /node/69a655ea7da105ad098377ee HTTP/1.0" 202 Accepted 2026-03-05 03:31:05,852 - lava_callback - INFO - Starting async job submit for node 69a655ea7da105ad098377ee 2026-03-05 03:31:05,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:31:05,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a655ea7da105ad098377ee HTTP/1.1" 200 None 2026-03-05 03:31:05,870 - lava_callback - DEBUG - Processing node 69a655ea7da105ad098377ee: baseline-arm64-baylibre 2026-03-05 03:31:05,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a655ea7da105ad098377ee 2026-03-05 03:31:05,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:31:05,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a655ea7da105ad098377ee HTTP/1.1" 200 None 2026-03-05 03:31:05,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:31:05,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5479a2f71ebbe58f1bc6c HTTP/1.1" 200 None 2026-03-05 03:31:05,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:31:05,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a655ea7da105ad098377ee HTTP/1.1" 200 None 2026-03-05 03:31:05,922 - lava_callback - ERROR - Error processing callback for node 69a655ea7da105ad098377ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:37:27,617 - lava_callback - INFO - Received callback for node 69a8f698911a9cbe7f77f824 INFO: 172.21.0.1:53148 - "POST /node/69a8f698911a9cbe7f77f824 HTTP/1.0" 202 Accepted 2026-03-05 03:37:27,624 - lava_callback - INFO - Starting async job submit for node 69a8f698911a9cbe7f77f824 2026-03-05 03:37:27,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:37:27,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f698911a9cbe7f77f824 HTTP/1.1" 200 None 2026-03-05 03:37:27,692 - lava_callback - DEBUG - Processing node 69a8f698911a9cbe7f77f824: baseline-arm 2026-03-05 03:37:28,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:37:28,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:37:28,512 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69a8f698911a9cbe7f77f824/log.txt.gz 2026-03-05 03:37:28,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:37:29,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:37:29,123 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69a8f698911a9cbe7f77f824/lava-logs.yaml 2026-03-05 03:37:29,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:37:29,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:37:29,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69a8f698911a9cbe7f77f824/lava_callback.json.gz DEBUG: Setup failed for 69a8f698911a9cbe7f77f824. Transitting job node result: incomplete -> fail 2026-03-05 03:37:29,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:37:29,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f698911a9cbe7f77f824 HTTP/1.1" 200 None 2026-03-05 03:37:29,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:37:29,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 03:37:29,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:37:29,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f698911a9cbe7f77f824 HTTP/1.1" 200 None 2026-03-05 03:37:29,590 - lava_callback - INFO - Completed processing callback for node 69a8f698911a9cbe7f77f824 INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:37:53,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:37:53,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-05 03:41:15,605 - lava_callback - INFO - Received callback for node 69a8f6ce911a9cbe7f77f873 INFO: 172.21.0.1:33918 - "POST /node/69a8f6ce911a9cbe7f77f873 HTTP/1.0" 202 Accepted 2026-03-05 03:41:15,613 - lava_callback - INFO - Starting async job submit for node 69a8f6ce911a9cbe7f77f873 2026-03-05 03:41:15,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:41:15,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f6ce911a9cbe7f77f873 HTTP/1.1" 200 None 2026-03-05 03:41:15,661 - lava_callback - DEBUG - Processing node 69a8f6ce911a9cbe7f77f873: baseline-arm-clabbe 2026-03-05 03:41:15,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:41:16,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:41:16,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8f6ce911a9cbe7f77f873/log.txt.gz 2026-03-05 03:41:16,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:41:16,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:41:16,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8f6ce911a9cbe7f77f873/lava-logs.yaml 2026-03-05 03:41:16,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:41:16,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:41:16,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69a8f6ce911a9cbe7f77f873/lava_callback.json.gz DEBUG: Setup failed for 69a8f6ce911a9cbe7f77f873. Transitting job node result: incomplete -> fail 2026-03-05 03:41:16,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:41:16,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f6ce911a9cbe7f77f873 HTTP/1.1" 200 None 2026-03-05 03:41:16,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:41:16,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 03:41:16,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:41:16,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f6ce911a9cbe7f77f873 HTTP/1.1" 200 None 2026-03-05 03:41:16,738 - lava_callback - INFO - Completed processing callback for node 69a8f6ce911a9cbe7f77f873 2026-03-05 03:41:23,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:41:23,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:42:10,998 - lava_callback - INFO - Received callback for node 69a8f701911a9cbe7f77f8b6 INFO: 172.21.0.1:45812 - "POST /node/69a8f701911a9cbe7f77f8b6 HTTP/1.0" 202 Accepted 2026-03-05 03:42:11,045 - lava_callback - INFO - Starting async job submit for node 69a8f701911a9cbe7f77f8b6 2026-03-05 03:42:11,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:42:11,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f701911a9cbe7f77f8b6 HTTP/1.1" 200 None 2026-03-05 03:42:11,133 - lava_callback - DEBUG - Processing node 69a8f701911a9cbe7f77f8b6: baseline-arm-pengutronix 2026-03-05 03:42:11,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:42:11,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:42:11,371 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8f701911a9cbe7f77f8b6/log.txt.gz 2026-03-05 03:42:11,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:42:11,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:42:11,590 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8f701911a9cbe7f77f8b6/lava-logs.yaml 2026-03-05 03:42:11,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:42:11,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:42:11,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69a8f701911a9cbe7f77f8b6/lava_callback.json.gz DEBUG: Setup failed for 69a8f701911a9cbe7f77f8b6. Transitting job node result: incomplete -> fail 2026-03-05 03:42:11,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:42:11,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f701911a9cbe7f77f8b6 HTTP/1.1" 200 None 2026-03-05 03:42:11,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:42:11,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-05 03:42:11,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:42:11,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f701911a9cbe7f77f8b6 HTTP/1.1" 200 None 2026-03-05 03:42:11,919 - lava_callback - INFO - Completed processing callback for node 69a8f701911a9cbe7f77f8b6 INFO: 172.21.0.1:45828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:42:23,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:42:23,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:43:22,557 - lava_callback - INFO - Received callback for node 69a8f72b911a9cbe7f77f8dd INFO: 172.21.0.1:52378 - "POST /node/69a8f72b911a9cbe7f77f8dd HTTP/1.0" 202 Accepted 2026-03-05 03:43:22,571 - lava_callback - INFO - Starting async job submit for node 69a8f72b911a9cbe7f77f8dd 2026-03-05 03:43:22,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:43:22,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f72b911a9cbe7f77f8dd HTTP/1.1" 200 None 2026-03-05 03:43:22,679 - lava_callback - DEBUG - Processing node 69a8f72b911a9cbe7f77f8dd: baseline-nfs-arm64 2026-03-05 03:43:23,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:43:24,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:43:24,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8f72b911a9cbe7f77f8dd/log.txt.gz 2026-03-05 03:43:24,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:43:25,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:43:25,142 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8f72b911a9cbe7f77f8dd/lava-logs.yaml 2026-03-05 03:43:25,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-05 03:43:25,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-05 03:43:25,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69a8f72b911a9cbe7f77f8dd/lava_callback.json.gz DEBUG: Setup failed for 69a8f72b911a9cbe7f77f8dd. Transitting job node result: incomplete -> fail 2026-03-05 03:43:25,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:43:25,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f72b911a9cbe7f77f8dd HTTP/1.1" 200 None 2026-03-05 03:43:25,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:43:25,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-05 03:43:25,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:43:25,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f72b911a9cbe7f77f8dd HTTP/1.1" 200 None 2026-03-05 03:43:25,582 - lava_callback - INFO - Completed processing callback for node 69a8f72b911a9cbe7f77f8dd INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK 2026-03-05 03:43:53,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 03:43:53,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK 2026-03-05 04:49:09,999 - lava_callback - INFO - Received callback for node 69a668357da105ad0983789f INFO: 172.21.0.1:57486 - "POST /node/69a668357da105ad0983789f HTTP/1.0" 202 Accepted 2026-03-05 04:49:10,004 - lava_callback - INFO - Starting async job submit for node 69a668357da105ad0983789f 2026-03-05 04:49:10,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:49:10,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a668357da105ad0983789f HTTP/1.1" 200 None 2026-03-05 04:49:10,020 - lava_callback - DEBUG - Processing node 69a668357da105ad0983789f: baseline-arm-baylibre 2026-03-05 04:49:10,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a668357da105ad0983789f 2026-03-05 04:49:10,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:49:10,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a668357da105ad0983789f HTTP/1.1" 200 None 2026-03-05 04:49:10,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:49:10,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-05 04:49:10,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:49:10,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a668357da105ad0983789f HTTP/1.1" 200 None 2026-03-05 04:49:10,090 - lava_callback - ERROR - Error processing callback for node 69a668357da105ad0983789f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK 2026-03-05 04:49:49,887 - lava_callback - INFO - Received callback for node 69a668687da105ad098378da INFO: 172.21.0.1:54276 - "POST /node/69a668687da105ad098378da HTTP/1.0" 202 Accepted 2026-03-05 04:49:49,893 - lava_callback - INFO - Starting async job submit for node 69a668687da105ad098378da 2026-03-05 04:49:49,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:49:49,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a668687da105ad098378da HTTP/1.1" 200 None 2026-03-05 04:49:49,910 - lava_callback - DEBUG - Processing node 69a668687da105ad098378da: baseline-arm-baylibre 2026-03-05 04:49:49,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a668687da105ad098378da 2026-03-05 04:49:49,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:49:49,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a668687da105ad098378da HTTP/1.1" 200 None 2026-03-05 04:49:49,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:49:49,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-05 04:49:49,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:49:49,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a668687da105ad098378da HTTP/1.1" 200 None 2026-03-05 04:49:49,963 - lava_callback - ERROR - Error processing callback for node 69a668687da105ad098378da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK 2026-03-05 04:50:50,027 - lava_callback - INFO - Received callback for node 69a6689a7da105ad098378ef INFO: 172.21.0.1:43620 - "POST /node/69a6689a7da105ad098378ef HTTP/1.0" 202 Accepted 2026-03-05 04:50:50,032 - lava_callback - INFO - Starting async job submit for node 69a6689a7da105ad098378ef 2026-03-05 04:50:50,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:50:50,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6689a7da105ad098378ef HTTP/1.1" 200 None 2026-03-05 04:50:50,049 - lava_callback - DEBUG - Processing node 69a6689a7da105ad098378ef: baseline-arm-baylibre 2026-03-05 04:50:50,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6689a7da105ad098378ef 2026-03-05 04:50:50,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:50:50,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6689a7da105ad098378ef HTTP/1.1" 200 None 2026-03-05 04:50:50,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:50:50,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-05 04:50:50,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:50:50,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6689a7da105ad098378ef HTTP/1.1" 200 None 2026-03-05 04:50:50,109 - lava_callback - ERROR - Error processing callback for node 69a6689a7da105ad098378ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK 2026-03-05 04:51:30,001 - lava_callback - INFO - Received callback for node 69a668cd7da105ad0983792e INFO: 172.21.0.1:39166 - "POST /node/69a668cd7da105ad0983792e HTTP/1.0" 202 Accepted 2026-03-05 04:51:30,007 - lava_callback - INFO - Starting async job submit for node 69a668cd7da105ad0983792e 2026-03-05 04:51:30,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:51:30,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a668cd7da105ad0983792e HTTP/1.1" 200 None 2026-03-05 04:51:30,023 - lava_callback - DEBUG - Processing node 69a668cd7da105ad0983792e: baseline-arm-baylibre 2026-03-05 04:51:30,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a668cd7da105ad0983792e 2026-03-05 04:51:30,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:51:30,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a668cd7da105ad0983792e HTTP/1.1" 200 None 2026-03-05 04:51:30,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:51:30,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-05 04:51:30,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:51:30,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a668cd7da105ad0983792e HTTP/1.1" 200 None 2026-03-05 04:51:30,101 - lava_callback - ERROR - Error processing callback for node 69a668cd7da105ad0983792e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK 2026-03-05 04:52:30,074 - lava_callback - INFO - Received callback for node 69a669017da105ad09837968 INFO: 172.21.0.1:54856 - "POST /node/69a669017da105ad09837968 HTTP/1.0" 202 Accepted 2026-03-05 04:52:30,079 - lava_callback - INFO - Starting async job submit for node 69a669017da105ad09837968 2026-03-05 04:52:30,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:52:30,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a669017da105ad09837968 HTTP/1.1" 200 None 2026-03-05 04:52:30,095 - lava_callback - DEBUG - Processing node 69a669017da105ad09837968: baseline-arm-baylibre 2026-03-05 04:52:30,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a669017da105ad09837968 2026-03-05 04:52:30,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:52:30,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a669017da105ad09837968 HTTP/1.1" 200 None 2026-03-05 04:52:30,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:52:30,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-05 04:52:30,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:52:30,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a669017da105ad09837968 HTTP/1.1" 200 None 2026-03-05 04:52:30,161 - lava_callback - ERROR - Error processing callback for node 69a669017da105ad09837968: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK 2026-03-05 04:53:10,088 - lava_callback - INFO - Received callback for node 69a669337da105ad0983797c INFO: 172.21.0.1:45086 - "POST /node/69a669337da105ad0983797c HTTP/1.0" 202 Accepted 2026-03-05 04:53:10,094 - lava_callback - INFO - Starting async job submit for node 69a669337da105ad0983797c 2026-03-05 04:53:10,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:53:10,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a669337da105ad0983797c HTTP/1.1" 200 None 2026-03-05 04:53:10,111 - lava_callback - DEBUG - Processing node 69a669337da105ad0983797c: baseline-arm-baylibre 2026-03-05 04:53:10,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a669337da105ad0983797c 2026-03-05 04:53:10,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:53:10,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a669337da105ad0983797c HTTP/1.1" 200 None 2026-03-05 04:53:10,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:53:10,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-05 04:53:10,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 04:53:10,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a669337da105ad0983797c HTTP/1.1" 200 None 2026-03-05 04:53:10,180 - lava_callback - ERROR - Error processing callback for node 69a669337da105ad0983797c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:13:51,420 - lava_callback - INFO - Received callback for node 69a66e077da105ad09837d05 INFO: 172.21.0.1:39606 - "POST /node/69a66e077da105ad09837d05 HTTP/1.0" 202 Accepted 2026-03-05 05:13:51,430 - lava_callback - INFO - Starting async job submit for node 69a66e077da105ad09837d05 2026-03-05 05:13:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:13:51,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66e077da105ad09837d05 HTTP/1.1" 200 None 2026-03-05 05:13:51,480 - lava_callback - DEBUG - Processing node 69a66e077da105ad09837d05: baseline-arm64-baylibre 2026-03-05 05:13:51,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a66e077da105ad09837d05 2026-03-05 05:13:51,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:13:51,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66e077da105ad09837d05 HTTP/1.1" 200 None 2026-03-05 05:13:51,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:13:51,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-05 05:13:51,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:13:51,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a66e077da105ad09837d05 HTTP/1.1" 200 None 2026-03-05 05:13:51,565 - lava_callback - ERROR - Error processing callback for node 69a66e077da105ad09837d05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:15:11,326 - lava_callback - INFO - Received callback for node 69a66e5d7da105ad09837d09 INFO: 172.21.0.1:51814 - "POST /node/69a66e5d7da105ad09837d09 HTTP/1.0" 202 Accepted 2026-03-05 05:15:11,332 - lava_callback - INFO - Starting async job submit for node 69a66e5d7da105ad09837d09 2026-03-05 05:15:11,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:15:11,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66e5d7da105ad09837d09 HTTP/1.1" 200 None 2026-03-05 05:15:11,349 - lava_callback - DEBUG - Processing node 69a66e5d7da105ad09837d09: baseline-arm64-baylibre 2026-03-05 05:15:11,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a66e5d7da105ad09837d09 2026-03-05 05:15:11,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:15:11,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66e5d7da105ad09837d09 HTTP/1.1" 200 None 2026-03-05 05:15:11,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:15:11,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-05 05:15:11,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:15:11,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a66e5d7da105ad09837d09 HTTP/1.1" 200 None 2026-03-05 05:15:11,421 - lava_callback - ERROR - Error processing callback for node 69a66e5d7da105ad09837d09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:16:51,441 - lava_callback - INFO - Received callback for node 69a66eb47da105ad09837d18 INFO: 172.21.0.1:54358 - "POST /node/69a66eb47da105ad09837d18 HTTP/1.0" 202 Accepted 2026-03-05 05:16:51,447 - lava_callback - INFO - Starting async job submit for node 69a66eb47da105ad09837d18 2026-03-05 05:16:51,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:16:51,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66eb47da105ad09837d18 HTTP/1.1" 200 None 2026-03-05 05:16:51,462 - lava_callback - DEBUG - Processing node 69a66eb47da105ad09837d18: baseline-arm64-baylibre 2026-03-05 05:16:51,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a66eb47da105ad09837d18 2026-03-05 05:16:51,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:16:51,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66eb47da105ad09837d18 HTTP/1.1" 200 None 2026-03-05 05:16:51,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:16:51,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-05 05:16:51,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:16:51,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a66eb47da105ad09837d18 HTTP/1.1" 200 None 2026-03-05 05:16:51,530 - lava_callback - ERROR - Error processing callback for node 69a66eb47da105ad09837d18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:18:11,533 - lava_callback - INFO - Received callback for node 69a66f0d7da105ad09837d20 INFO: 172.21.0.1:53398 - "POST /node/69a66f0d7da105ad09837d20 HTTP/1.0" 202 Accepted 2026-03-05 05:18:11,539 - lava_callback - INFO - Starting async job submit for node 69a66f0d7da105ad09837d20 2026-03-05 05:18:11,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:18:11,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66f0d7da105ad09837d20 HTTP/1.1" 200 None 2026-03-05 05:18:11,572 - lava_callback - DEBUG - Processing node 69a66f0d7da105ad09837d20: baseline-arm64-baylibre 2026-03-05 05:18:11,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a66f0d7da105ad09837d20 2026-03-05 05:18:11,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:18:11,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66f0d7da105ad09837d20 HTTP/1.1" 200 None 2026-03-05 05:18:11,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:18:11,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-05 05:18:11,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:18:11,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a66f0d7da105ad09837d20 HTTP/1.1" 200 None 2026-03-05 05:18:11,635 - lava_callback - ERROR - Error processing callback for node 69a66f0d7da105ad09837d20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:19:51,706 - lava_callback - INFO - Received callback for node 69a66f677da105ad09837d37 INFO: 172.21.0.1:60060 - "POST /node/69a66f677da105ad09837d37 HTTP/1.0" 202 Accepted 2026-03-05 05:19:51,711 - lava_callback - INFO - Starting async job submit for node 69a66f677da105ad09837d37 2026-03-05 05:19:51,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:19:51,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66f677da105ad09837d37 HTTP/1.1" 200 None 2026-03-05 05:19:51,727 - lava_callback - DEBUG - Processing node 69a66f677da105ad09837d37: baseline-arm64-baylibre 2026-03-05 05:19:51,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a66f677da105ad09837d37 2026-03-05 05:19:51,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:19:51,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66f677da105ad09837d37 HTTP/1.1" 200 None 2026-03-05 05:19:51,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:19:51,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-05 05:19:51,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:19:51,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a66f677da105ad09837d37 HTTP/1.1" 200 None 2026-03-05 05:19:51,837 - lava_callback - ERROR - Error processing callback for node 69a66f677da105ad09837d37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:21:11,697 - lava_callback - INFO - Received callback for node 69a66fc27da105ad09837d48 INFO: 172.21.0.1:48924 - "POST /node/69a66fc27da105ad09837d48 HTTP/1.0" 202 Accepted 2026-03-05 05:21:11,703 - lava_callback - INFO - Starting async job submit for node 69a66fc27da105ad09837d48 2026-03-05 05:21:11,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:21:11,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66fc27da105ad09837d48 HTTP/1.1" 200 None 2026-03-05 05:21:11,719 - lava_callback - DEBUG - Processing node 69a66fc27da105ad09837d48: baseline-arm64-baylibre 2026-03-05 05:21:11,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a66fc27da105ad09837d48 2026-03-05 05:21:11,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:21:11,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a66fc27da105ad09837d48 HTTP/1.1" 200 None 2026-03-05 05:21:11,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:21:11,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-05 05:21:11,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:21:11,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a66fc27da105ad09837d48 HTTP/1.1" 200 None 2026-03-05 05:21:11,779 - lava_callback - ERROR - Error processing callback for node 69a66fc27da105ad09837d48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:49:33,292 - lava_callback - INFO - Received callback for node 69a676697da105ad09837dc4 INFO: 172.21.0.1:33312 - "POST /node/69a676697da105ad09837dc4 HTTP/1.0" 202 Accepted 2026-03-05 05:49:33,298 - lava_callback - INFO - Starting async job submit for node 69a676697da105ad09837dc4 2026-03-05 05:49:33,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:49:33,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a676697da105ad09837dc4 HTTP/1.1" 200 None 2026-03-05 05:49:33,314 - lava_callback - DEBUG - Processing node 69a676697da105ad09837dc4: baseline-arm64-baylibre 2026-03-05 05:49:33,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a676697da105ad09837dc4 2026-03-05 05:49:33,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:49:33,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a676697da105ad09837dc4 HTTP/1.1" 200 None 2026-03-05 05:49:33,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:49:33,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-05 05:49:33,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:49:33,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a676697da105ad09837dc4 HTTP/1.1" 200 None 2026-03-05 05:49:33,379 - lava_callback - ERROR - Error processing callback for node 69a676697da105ad09837dc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:51:13,262 - lava_callback - INFO - Received callback for node 69a676c37da105ad09837dd9 INFO: 172.21.0.1:36056 - "POST /node/69a676c37da105ad09837dd9 HTTP/1.0" 202 Accepted 2026-03-05 05:51:13,268 - lava_callback - INFO - Starting async job submit for node 69a676c37da105ad09837dd9 2026-03-05 05:51:13,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:51:13,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a676c37da105ad09837dd9 HTTP/1.1" 200 None 2026-03-05 05:51:13,283 - lava_callback - DEBUG - Processing node 69a676c37da105ad09837dd9: baseline-arm64-baylibre 2026-03-05 05:51:13,284 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a676c37da105ad09837dd9 2026-03-05 05:51:13,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:51:13,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a676c37da105ad09837dd9 HTTP/1.1" 200 None 2026-03-05 05:51:13,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:51:13,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-05 05:51:13,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:51:13,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a676c37da105ad09837dd9 HTTP/1.1" 200 None 2026-03-05 05:51:13,336 - lava_callback - ERROR - Error processing callback for node 69a676c37da105ad09837dd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:52:33,365 - lava_callback - INFO - Received callback for node 69a6771e7da105ad09837dec INFO: 172.21.0.1:51432 - "POST /node/69a6771e7da105ad09837dec HTTP/1.0" 202 Accepted 2026-03-05 05:52:33,371 - lava_callback - INFO - Starting async job submit for node 69a6771e7da105ad09837dec 2026-03-05 05:52:33,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:52:33,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6771e7da105ad09837dec HTTP/1.1" 200 None 2026-03-05 05:52:33,389 - lava_callback - DEBUG - Processing node 69a6771e7da105ad09837dec: baseline-arm64-baylibre 2026-03-05 05:52:33,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6771e7da105ad09837dec 2026-03-05 05:52:33,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:52:33,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6771e7da105ad09837dec HTTP/1.1" 200 None 2026-03-05 05:52:33,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:52:33,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-05 05:52:33,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:52:33,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6771e7da105ad09837dec HTTP/1.1" 200 None 2026-03-05 05:52:33,457 - lava_callback - ERROR - Error processing callback for node 69a6771e7da105ad09837dec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:54:13,464 - lava_callback - INFO - Received callback for node 69a677787da105ad09837e02 INFO: 172.21.0.1:59540 - "POST /node/69a677787da105ad09837e02 HTTP/1.0" 202 Accepted 2026-03-05 05:54:13,470 - lava_callback - INFO - Starting async job submit for node 69a677787da105ad09837e02 2026-03-05 05:54:13,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:54:13,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a677787da105ad09837e02 HTTP/1.1" 200 None 2026-03-05 05:54:13,495 - lava_callback - DEBUG - Processing node 69a677787da105ad09837e02: baseline-arm64-baylibre 2026-03-05 05:54:13,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a677787da105ad09837e02 2026-03-05 05:54:13,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:54:13,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a677787da105ad09837e02 HTTP/1.1" 200 None 2026-03-05 05:54:13,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:54:13,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-05 05:54:13,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:54:13,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a677787da105ad09837e02 HTTP/1.1" 200 None 2026-03-05 05:54:13,553 - lava_callback - ERROR - Error processing callback for node 69a677787da105ad09837e02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:55:33,578 - lava_callback - INFO - Received callback for node 69a677d37da105ad09837e15 INFO: 172.21.0.1:55488 - "POST /node/69a677d37da105ad09837e15 HTTP/1.0" 202 Accepted 2026-03-05 05:55:33,584 - lava_callback - INFO - Starting async job submit for node 69a677d37da105ad09837e15 2026-03-05 05:55:33,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:55:33,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a677d37da105ad09837e15 HTTP/1.1" 200 None 2026-03-05 05:55:33,612 - lava_callback - DEBUG - Processing node 69a677d37da105ad09837e15: baseline-arm64-baylibre 2026-03-05 05:55:33,612 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a677d37da105ad09837e15 2026-03-05 05:55:33,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:55:33,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a677d37da105ad09837e15 HTTP/1.1" 200 None 2026-03-05 05:55:33,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:55:33,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-05 05:55:33,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:55:33,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a677d37da105ad09837e15 HTTP/1.1" 200 None 2026-03-05 05:55:33,672 - lava_callback - ERROR - Error processing callback for node 69a677d37da105ad09837e15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK 2026-03-05 05:57:13,671 - lava_callback - INFO - Received callback for node 69a6782d7da105ad09837e2a INFO: 172.21.0.1:53162 - "POST /node/69a6782d7da105ad09837e2a HTTP/1.0" 202 Accepted 2026-03-05 05:57:13,677 - lava_callback - INFO - Starting async job submit for node 69a6782d7da105ad09837e2a 2026-03-05 05:57:13,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:57:13,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6782d7da105ad09837e2a HTTP/1.1" 200 None 2026-03-05 05:57:13,693 - lava_callback - DEBUG - Processing node 69a6782d7da105ad09837e2a: baseline-arm64-baylibre 2026-03-05 05:57:13,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6782d7da105ad09837e2a 2026-03-05 05:57:13,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:57:13,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6782d7da105ad09837e2a HTTP/1.1" 200 None 2026-03-05 05:57:13,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:57:13,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-05 05:57:13,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 05:57:13,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6782d7da105ad09837e2a HTTP/1.1" 200 None 2026-03-05 05:57:13,754 - lava_callback - ERROR - Error processing callback for node 69a6782d7da105ad09837e2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-05 06:40:16,024 - lava_callback - INFO - Received callback for node 69a682467da105ad09837eac INFO: 172.21.0.1:44858 - "POST /node/69a682467da105ad09837eac HTTP/1.0" 202 Accepted 2026-03-05 06:40:16,030 - lava_callback - INFO - Starting async job submit for node 69a682467da105ad09837eac 2026-03-05 06:40:16,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:40:16,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a682467da105ad09837eac HTTP/1.1" 200 None 2026-03-05 06:40:16,046 - lava_callback - DEBUG - Processing node 69a682467da105ad09837eac: baseline-arm-baylibre 2026-03-05 06:40:16,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a682467da105ad09837eac 2026-03-05 06:40:16,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:40:16,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a682467da105ad09837eac HTTP/1.1" 200 None 2026-03-05 06:40:16,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:40:16,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 06:40:16,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:40:16,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a682467da105ad09837eac HTTP/1.1" 200 None 2026-03-05 06:40:16,116 - lava_callback - ERROR - Error processing callback for node 69a682467da105ad09837eac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-05 06:41:16,045 - lava_callback - INFO - Received callback for node 69a682777da105ad09837ee8 INFO: 172.21.0.1:57322 - "POST /node/69a682777da105ad09837ee8 HTTP/1.0" 202 Accepted 2026-03-05 06:41:16,051 - lava_callback - INFO - Starting async job submit for node 69a682777da105ad09837ee8 2026-03-05 06:41:16,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:41:16,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a682777da105ad09837ee8 HTTP/1.1" 200 None 2026-03-05 06:41:16,067 - lava_callback - DEBUG - Processing node 69a682777da105ad09837ee8: baseline-arm-baylibre 2026-03-05 06:41:16,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a682777da105ad09837ee8 2026-03-05 06:41:16,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:41:16,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a682777da105ad09837ee8 HTTP/1.1" 200 None 2026-03-05 06:41:16,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:41:16,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 06:41:16,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:41:16,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a682777da105ad09837ee8 HTTP/1.1" 200 None 2026-03-05 06:41:16,133 - lava_callback - ERROR - Error processing callback for node 69a682777da105ad09837ee8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:41:56,133 - lava_callback - INFO - Received callback for node 69a682a97da105ad09837f20 INFO: 172.21.0.1:56718 - "POST /node/69a682a97da105ad09837f20 HTTP/1.0" 202 Accepted 2026-03-05 06:41:56,139 - lava_callback - INFO - Starting async job submit for node 69a682a97da105ad09837f20 2026-03-05 06:41:56,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:41:56,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a682a97da105ad09837f20 HTTP/1.1" 200 None 2026-03-05 06:41:56,160 - lava_callback - DEBUG - Processing node 69a682a97da105ad09837f20: baseline-arm-baylibre 2026-03-05 06:41:56,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a682a97da105ad09837f20 2026-03-05 06:41:56,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:41:56,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a682a97da105ad09837f20 HTTP/1.1" 200 None 2026-03-05 06:41:56,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:41:56,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 06:41:56,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:41:56,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a682a97da105ad09837f20 HTTP/1.1" 200 None 2026-03-05 06:41:56,253 - lava_callback - ERROR - Error processing callback for node 69a682a97da105ad09837f20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53694 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:42:36,096 - lava_callback - INFO - Received callback for node 69a682da7da105ad09837f33 INFO: 172.21.0.1:54620 - "POST /node/69a682da7da105ad09837f33 HTTP/1.0" 202 Accepted 2026-03-05 06:42:36,102 - lava_callback - INFO - Starting async job submit for node 69a682da7da105ad09837f33 2026-03-05 06:42:36,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:42:36,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a682da7da105ad09837f33 HTTP/1.1" 200 None 2026-03-05 06:42:36,119 - lava_callback - DEBUG - Processing node 69a682da7da105ad09837f33: baseline-arm-baylibre 2026-03-05 06:42:36,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a682da7da105ad09837f33 2026-03-05 06:42:36,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:42:36,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a682da7da105ad09837f33 HTTP/1.1" 200 None 2026-03-05 06:42:36,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:42:36,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 06:42:36,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:42:36,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a682da7da105ad09837f33 HTTP/1.1" 200 None 2026-03-05 06:42:36,184 - lava_callback - ERROR - Error processing callback for node 69a682da7da105ad09837f33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:43:36,193 - lava_callback - INFO - Received callback for node 69a6830d7da105ad09837f6f INFO: 172.21.0.1:48608 - "POST /node/69a6830d7da105ad09837f6f HTTP/1.0" 202 Accepted 2026-03-05 06:43:36,198 - lava_callback - INFO - Starting async job submit for node 69a6830d7da105ad09837f6f 2026-03-05 06:43:36,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:43:36,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6830d7da105ad09837f6f HTTP/1.1" 200 None 2026-03-05 06:43:36,214 - lava_callback - DEBUG - Processing node 69a6830d7da105ad09837f6f: baseline-arm-baylibre 2026-03-05 06:43:36,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6830d7da105ad09837f6f 2026-03-05 06:43:36,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:43:36,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6830d7da105ad09837f6f HTTP/1.1" 200 None 2026-03-05 06:43:36,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:43:36,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 06:43:36,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:43:36,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6830d7da105ad09837f6f HTTP/1.1" 200 None 2026-03-05 06:43:36,276 - lava_callback - ERROR - Error processing callback for node 69a6830d7da105ad09837f6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:44:36,226 - lava_callback - INFO - Received callback for node 69a6833f7da105ad09837fa4 INFO: 172.21.0.1:33102 - "POST /node/69a6833f7da105ad09837fa4 HTTP/1.0" 202 Accepted 2026-03-05 06:44:36,235 - lava_callback - INFO - Starting async job submit for node 69a6833f7da105ad09837fa4 2026-03-05 06:44:36,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:44:36,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6833f7da105ad09837fa4 HTTP/1.1" 200 None 2026-03-05 06:44:36,260 - lava_callback - DEBUG - Processing node 69a6833f7da105ad09837fa4: baseline-arm-baylibre 2026-03-05 06:44:36,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6833f7da105ad09837fa4 2026-03-05 06:44:36,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:44:36,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6833f7da105ad09837fa4 HTTP/1.1" 200 None 2026-03-05 06:44:36,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:44:36,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-05 06:44:36,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:44:36,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6833f7da105ad09837fa4 HTTP/1.1" 200 None 2026-03-05 06:44:36,339 - lava_callback - ERROR - Error processing callback for node 69a6833f7da105ad09837fa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:49:36,584 - lava_callback - INFO - Received callback for node 69a684737da105ad09838028 INFO: 172.21.0.1:33960 - "POST /node/69a684737da105ad09838028 HTTP/1.0" 202 Accepted 2026-03-05 06:49:36,594 - lava_callback - INFO - Starting async job submit for node 69a684737da105ad09838028 2026-03-05 06:49:36,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:49:36,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a684737da105ad09838028 HTTP/1.1" 200 None 2026-03-05 06:49:36,619 - lava_callback - DEBUG - Processing node 69a684737da105ad09838028: baseline-arm-baylibre 2026-03-05 06:49:36,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a684737da105ad09838028 2026-03-05 06:49:36,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:49:36,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a684737da105ad09838028 HTTP/1.1" 200 None 2026-03-05 06:49:36,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:49:36,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 06:49:36,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:49:36,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a684737da105ad09838028 HTTP/1.1" 200 None 2026-03-05 06:49:36,706 - lava_callback - ERROR - Error processing callback for node 69a684737da105ad09838028: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:50:36,572 - lava_callback - INFO - Received callback for node 69a684af7da105ad09838057 INFO: 172.21.0.1:55990 - "POST /node/69a684af7da105ad09838057 HTTP/1.0" 202 Accepted 2026-03-05 06:50:36,577 - lava_callback - INFO - Starting async job submit for node 69a684af7da105ad09838057 2026-03-05 06:50:36,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:50:36,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a684af7da105ad09838057 HTTP/1.1" 200 None 2026-03-05 06:50:36,593 - lava_callback - DEBUG - Processing node 69a684af7da105ad09838057: baseline-arm-baylibre 2026-03-05 06:50:36,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a684af7da105ad09838057 2026-03-05 06:50:36,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:50:36,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a684af7da105ad09838057 HTTP/1.1" 200 None 2026-03-05 06:50:36,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:50:36,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 06:50:36,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:50:36,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a684af7da105ad09838057 HTTP/1.1" 200 None 2026-03-05 06:50:36,648 - lava_callback - ERROR - Error processing callback for node 69a684af7da105ad09838057: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:53:36,839 - lava_callback - INFO - Received callback for node 69a685647da105ad09838086 INFO: 172.21.0.1:35378 - "POST /node/69a685647da105ad09838086 HTTP/1.0" 202 Accepted 2026-03-05 06:53:36,848 - lava_callback - INFO - Starting async job submit for node 69a685647da105ad09838086 2026-03-05 06:53:36,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:53:36,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a685647da105ad09838086 HTTP/1.1" 200 None 2026-03-05 06:53:36,871 - lava_callback - DEBUG - Processing node 69a685647da105ad09838086: baseline-arm-baylibre 2026-03-05 06:53:36,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a685647da105ad09838086 2026-03-05 06:53:36,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:53:36,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a685647da105ad09838086 HTTP/1.1" 200 None 2026-03-05 06:53:36,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:53:36,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 06:53:36,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:53:36,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a685647da105ad09838086 HTTP/1.1" 200 None 2026-03-05 06:53:36,949 - lava_callback - ERROR - Error processing callback for node 69a685647da105ad09838086: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:54:36,818 - lava_callback - INFO - Received callback for node 69a685a17da105ad098380b5 INFO: 172.21.0.1:54502 - "POST /node/69a685a17da105ad098380b5 HTTP/1.0" 202 Accepted 2026-03-05 06:54:36,823 - lava_callback - INFO - Starting async job submit for node 69a685a17da105ad098380b5 2026-03-05 06:54:36,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:54:36,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a685a17da105ad098380b5 HTTP/1.1" 200 None 2026-03-05 06:54:36,845 - lava_callback - DEBUG - Processing node 69a685a17da105ad098380b5: baseline-arm-baylibre 2026-03-05 06:54:36,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a685a17da105ad098380b5 2026-03-05 06:54:36,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:54:36,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a685a17da105ad098380b5 HTTP/1.1" 200 None 2026-03-05 06:54:36,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:54:36,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 06:54:36,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:54:36,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a685a17da105ad098380b5 HTTP/1.1" 200 None 2026-03-05 06:54:36,912 - lava_callback - ERROR - Error processing callback for node 69a685a17da105ad098380b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33976 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:55:36,989 - lava_callback - INFO - Received callback for node 69a685de7da105ad098380e6 INFO: 172.21.0.1:33986 - "POST /node/69a685de7da105ad098380e6 HTTP/1.0" 202 Accepted 2026-03-05 06:55:36,994 - lava_callback - INFO - Starting async job submit for node 69a685de7da105ad098380e6 2026-03-05 06:55:36,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:55:37,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a685de7da105ad098380e6 HTTP/1.1" 200 None 2026-03-05 06:55:37,016 - lava_callback - DEBUG - Processing node 69a685de7da105ad098380e6: baseline-arm-baylibre 2026-03-05 06:55:37,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a685de7da105ad098380e6 2026-03-05 06:55:37,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:55:37,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a685de7da105ad098380e6 HTTP/1.1" 200 None 2026-03-05 06:55:37,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:55:37,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 06:55:37,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:55:37,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a685de7da105ad098380e6 HTTP/1.1" 200 None 2026-03-05 06:55:37,069 - lava_callback - ERROR - Error processing callback for node 69a685de7da105ad098380e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53188 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:56:16,917 - lava_callback - INFO - Received callback for node 69a6860e7da105ad09838116 INFO: 172.21.0.1:53192 - "POST /node/69a6860e7da105ad09838116 HTTP/1.0" 202 Accepted 2026-03-05 06:56:16,923 - lava_callback - INFO - Starting async job submit for node 69a6860e7da105ad09838116 2026-03-05 06:56:16,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:56:16,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6860e7da105ad09838116 HTTP/1.1" 200 None 2026-03-05 06:56:16,938 - lava_callback - DEBUG - Processing node 69a6860e7da105ad09838116: baseline-arm-baylibre 2026-03-05 06:56:16,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6860e7da105ad09838116 2026-03-05 06:56:16,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:56:16,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6860e7da105ad09838116 HTTP/1.1" 200 None 2026-03-05 06:56:16,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:56:16,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-05 06:56:16,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:56:17,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6860e7da105ad09838116 HTTP/1.1" 200 None 2026-03-05 06:56:17,034 - lava_callback - ERROR - Error processing callback for node 69a6860e7da105ad09838116: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:57:37,124 - lava_callback - INFO - Received callback for node 69a686537da105ad09838142 INFO: 172.21.0.1:53342 - "POST /node/69a686537da105ad09838142 HTTP/1.0" 202 Accepted 2026-03-05 06:57:37,130 - lava_callback - INFO - Starting async job submit for node 69a686537da105ad09838142 2026-03-05 06:57:37,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:57:37,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a686537da105ad09838142 HTTP/1.1" 200 None 2026-03-05 06:57:37,156 - lava_callback - DEBUG - Processing node 69a686537da105ad09838142: baseline-arm-baylibre 2026-03-05 06:57:37,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a686537da105ad09838142 2026-03-05 06:57:37,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:57:37,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a686537da105ad09838142 HTTP/1.1" 200 None 2026-03-05 06:57:37,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:57:37,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 06:57:37,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:57:37,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a686537da105ad09838142 HTTP/1.1" 200 None 2026-03-05 06:57:37,208 - lava_callback - ERROR - Error processing callback for node 69a686537da105ad09838142: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:58:37,056 - lava_callback - INFO - Received callback for node 69a686907da105ad09838171 INFO: 172.21.0.1:57900 - "POST /node/69a686907da105ad09838171 HTTP/1.0" 202 Accepted 2026-03-05 06:58:37,061 - lava_callback - INFO - Starting async job submit for node 69a686907da105ad09838171 2026-03-05 06:58:37,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:58:37,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a686907da105ad09838171 HTTP/1.1" 200 None 2026-03-05 06:58:37,077 - lava_callback - DEBUG - Processing node 69a686907da105ad09838171: baseline-arm-baylibre 2026-03-05 06:58:37,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a686907da105ad09838171 2026-03-05 06:58:37,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:58:37,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a686907da105ad09838171 HTTP/1.1" 200 None 2026-03-05 06:58:37,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:58:37,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 06:58:37,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:58:37,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a686907da105ad09838171 HTTP/1.1" 200 None 2026-03-05 06:58:37,145 - lava_callback - ERROR - Error processing callback for node 69a686907da105ad09838171: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51126 - "GET / HTTP/1.0" 200 OK 2026-03-05 06:59:37,118 - lava_callback - INFO - Received callback for node 69a686cc7da105ad098381a0 INFO: 172.21.0.1:51140 - "POST /node/69a686cc7da105ad098381a0 HTTP/1.0" 202 Accepted 2026-03-05 06:59:37,124 - lava_callback - INFO - Starting async job submit for node 69a686cc7da105ad098381a0 2026-03-05 06:59:37,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:59:37,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a686cc7da105ad098381a0 HTTP/1.1" 200 None 2026-03-05 06:59:37,152 - lava_callback - DEBUG - Processing node 69a686cc7da105ad098381a0: baseline-arm-baylibre 2026-03-05 06:59:37,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a686cc7da105ad098381a0 2026-03-05 06:59:37,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:59:37,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a686cc7da105ad098381a0 HTTP/1.1" 200 None 2026-03-05 06:59:37,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:59:37,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 06:59:37,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 06:59:37,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a686cc7da105ad098381a0 HTTP/1.1" 200 None 2026-03-05 06:59:37,207 - lava_callback - ERROR - Error processing callback for node 69a686cc7da105ad098381a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59854 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:01:37,232 - lava_callback - INFO - Received callback for node 69a687457da105ad098381cf INFO: 172.21.0.1:59862 - "POST /node/69a687457da105ad098381cf HTTP/1.0" 202 Accepted 2026-03-05 07:01:37,238 - lava_callback - INFO - Starting async job submit for node 69a687457da105ad098381cf 2026-03-05 07:01:37,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:01:37,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a687457da105ad098381cf HTTP/1.1" 200 None 2026-03-05 07:01:37,255 - lava_callback - DEBUG - Processing node 69a687457da105ad098381cf: baseline-arm-baylibre 2026-03-05 07:01:37,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a687457da105ad098381cf 2026-03-05 07:01:37,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:01:37,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a687457da105ad098381cf HTTP/1.1" 200 None 2026-03-05 07:01:37,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:01:37,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 07:01:37,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:01:37,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a687457da105ad098381cf HTTP/1.1" 200 None 2026-03-05 07:01:37,316 - lava_callback - ERROR - Error processing callback for node 69a687457da105ad098381cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:04:37,411 - lava_callback - INFO - Received callback for node 69a687fb7da105ad098381fe INFO: 172.21.0.1:36404 - "POST /node/69a687fb7da105ad098381fe HTTP/1.0" 202 Accepted 2026-03-05 07:04:37,417 - lava_callback - INFO - Starting async job submit for node 69a687fb7da105ad098381fe 2026-03-05 07:04:37,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:04:37,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a687fb7da105ad098381fe HTTP/1.1" 200 None 2026-03-05 07:04:37,437 - lava_callback - DEBUG - Processing node 69a687fb7da105ad098381fe: baseline-arm-baylibre 2026-03-05 07:04:37,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a687fb7da105ad098381fe 2026-03-05 07:04:37,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:04:37,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a687fb7da105ad098381fe HTTP/1.1" 200 None 2026-03-05 07:04:37,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:04:37,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 07:04:37,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:04:37,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a687fb7da105ad098381fe HTTP/1.1" 200 None 2026-03-05 07:04:37,490 - lava_callback - ERROR - Error processing callback for node 69a687fb7da105ad098381fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43284 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:06:37,542 - lava_callback - INFO - Received callback for node 69a688737da105ad0983822d INFO: 172.21.0.1:43290 - "POST /node/69a688737da105ad0983822d HTTP/1.0" 202 Accepted 2026-03-05 07:06:37,548 - lava_callback - INFO - Starting async job submit for node 69a688737da105ad0983822d 2026-03-05 07:06:37,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:06:37,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a688737da105ad0983822d HTTP/1.1" 200 None 2026-03-05 07:06:37,605 - lava_callback - DEBUG - Processing node 69a688737da105ad0983822d: baseline-arm-baylibre 2026-03-05 07:06:37,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a688737da105ad0983822d 2026-03-05 07:06:37,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:06:37,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a688737da105ad0983822d HTTP/1.1" 200 None 2026-03-05 07:06:37,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:06:37,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-05 07:06:37,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:06:37,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a688737da105ad0983822d HTTP/1.1" 200 None 2026-03-05 07:06:37,668 - lava_callback - ERROR - Error processing callback for node 69a688737da105ad0983822d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:10:57,843 - lava_callback - INFO - Received callback for node 69a6896d7da105ad0983825d INFO: 172.21.0.1:49504 - "POST /node/69a6896d7da105ad0983825d HTTP/1.0" 202 Accepted 2026-03-05 07:10:57,848 - lava_callback - INFO - Starting async job submit for node 69a6896d7da105ad0983825d 2026-03-05 07:10:57,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:10:57,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6896d7da105ad0983825d HTTP/1.1" 200 None 2026-03-05 07:10:57,864 - lava_callback - DEBUG - Processing node 69a6896d7da105ad0983825d: baseline-arm64-baylibre 2026-03-05 07:10:57,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6896d7da105ad0983825d 2026-03-05 07:10:57,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:10:57,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6896d7da105ad0983825d HTTP/1.1" 200 None 2026-03-05 07:10:57,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:10:57,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 07:10:57,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:10:57,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6896d7da105ad0983825d HTTP/1.1" 200 None 2026-03-05 07:10:57,916 - lava_callback - ERROR - Error processing callback for node 69a6896d7da105ad0983825d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:12:17,963 - lava_callback - INFO - Received callback for node 69a689c67da105ad09838270 INFO: 172.21.0.1:50030 - "POST /node/69a689c67da105ad09838270 HTTP/1.0" 202 Accepted 2026-03-05 07:12:17,972 - lava_callback - INFO - Starting async job submit for node 69a689c67da105ad09838270 2026-03-05 07:12:17,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:12:17,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a689c67da105ad09838270 HTTP/1.1" 200 None 2026-03-05 07:12:17,995 - lava_callback - DEBUG - Processing node 69a689c67da105ad09838270: baseline-arm64-baylibre 2026-03-05 07:12:17,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a689c67da105ad09838270 2026-03-05 07:12:17,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:12:18,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a689c67da105ad09838270 HTTP/1.1" 200 None 2026-03-05 07:12:18,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:12:18,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 07:12:18,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:12:18,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a689c67da105ad09838270 HTTP/1.1" 200 None 2026-03-05 07:12:18,062 - lava_callback - ERROR - Error processing callback for node 69a689c67da105ad09838270: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:16:38,185 - lava_callback - INFO - Received callback for node 69a68acf7da105ad098382cd INFO: 172.21.0.1:54872 - "POST /node/69a68acf7da105ad098382cd HTTP/1.0" 202 Accepted 2026-03-05 07:16:38,194 - lava_callback - INFO - Starting async job submit for node 69a68acf7da105ad098382cd 2026-03-05 07:16:38,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:16:38,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68acf7da105ad098382cd HTTP/1.1" 200 None 2026-03-05 07:16:38,230 - lava_callback - DEBUG - Processing node 69a68acf7da105ad098382cd: baseline-arm64-baylibre 2026-03-05 07:16:38,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68acf7da105ad098382cd 2026-03-05 07:16:38,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:16:38,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68acf7da105ad098382cd HTTP/1.1" 200 None 2026-03-05 07:16:38,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:16:38,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 07:16:38,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:16:38,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68acf7da105ad098382cd HTTP/1.1" 200 None 2026-03-05 07:16:38,306 - lava_callback - ERROR - Error processing callback for node 69a68acf7da105ad098382cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:18:18,196 - lava_callback - INFO - Received callback for node 69a68b297da105ad098382df INFO: 172.21.0.1:47256 - "POST /node/69a68b297da105ad098382df HTTP/1.0" 202 Accepted 2026-03-05 07:18:18,201 - lava_callback - INFO - Starting async job submit for node 69a68b297da105ad098382df 2026-03-05 07:18:18,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:18:18,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68b297da105ad098382df HTTP/1.1" 200 None 2026-03-05 07:18:18,217 - lava_callback - DEBUG - Processing node 69a68b297da105ad098382df: baseline-arm64-baylibre 2026-03-05 07:18:18,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68b297da105ad098382df 2026-03-05 07:18:18,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:18:18,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68b297da105ad098382df HTTP/1.1" 200 None 2026-03-05 07:18:18,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:18:18,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 07:18:18,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:18:18,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68b297da105ad098382df HTTP/1.1" 200 None 2026-03-05 07:18:18,275 - lava_callback - ERROR - Error processing callback for node 69a68b297da105ad098382df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:19:38,284 - lava_callback - INFO - Received callback for node 69a68b827da105ad098382ea INFO: 172.21.0.1:45360 - "POST /node/69a68b827da105ad098382ea HTTP/1.0" 202 Accepted 2026-03-05 07:19:38,290 - lava_callback - INFO - Starting async job submit for node 69a68b827da105ad098382ea 2026-03-05 07:19:38,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:19:38,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68b827da105ad098382ea HTTP/1.1" 200 None 2026-03-05 07:19:38,306 - lava_callback - DEBUG - Processing node 69a68b827da105ad098382ea: baseline-arm64-baylibre 2026-03-05 07:19:38,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68b827da105ad098382ea 2026-03-05 07:19:38,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:19:38,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68b827da105ad098382ea HTTP/1.1" 200 None 2026-03-05 07:19:38,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:19:38,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 07:19:38,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:19:38,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68b827da105ad098382ea HTTP/1.1" 200 None 2026-03-05 07:19:38,407 - lava_callback - ERROR - Error processing callback for node 69a68b827da105ad098382ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:21:18,342 - lava_callback - INFO - Received callback for node 69a68be27da105ad098382f6 INFO: 172.21.0.1:33848 - "POST /node/69a68be27da105ad098382f6 HTTP/1.0" 202 Accepted 2026-03-05 07:21:18,352 - lava_callback - INFO - Starting async job submit for node 69a68be27da105ad098382f6 2026-03-05 07:21:18,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:21:18,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68be27da105ad098382f6 HTTP/1.1" 200 None 2026-03-05 07:21:18,374 - lava_callback - DEBUG - Processing node 69a68be27da105ad098382f6: baseline-arm64-baylibre 2026-03-05 07:21:18,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68be27da105ad098382f6 2026-03-05 07:21:18,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:21:18,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68be27da105ad098382f6 HTTP/1.1" 200 None 2026-03-05 07:21:18,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:21:18,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 07:21:18,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:21:18,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68be27da105ad098382f6 HTTP/1.1" 200 None 2026-03-05 07:21:18,458 - lava_callback - ERROR - Error processing callback for node 69a68be27da105ad098382f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:22:38,397 - lava_callback - INFO - Received callback for node 69a68c397da105ad098382fd INFO: 172.21.0.1:36688 - "POST /node/69a68c397da105ad098382fd HTTP/1.0" 202 Accepted 2026-03-05 07:22:38,403 - lava_callback - INFO - Starting async job submit for node 69a68c397da105ad098382fd 2026-03-05 07:22:38,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:22:38,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68c397da105ad098382fd HTTP/1.1" 200 None 2026-03-05 07:22:38,420 - lava_callback - DEBUG - Processing node 69a68c397da105ad098382fd: baseline-arm64-baylibre 2026-03-05 07:22:38,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68c397da105ad098382fd 2026-03-05 07:22:38,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:22:38,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68c397da105ad098382fd HTTP/1.1" 200 None 2026-03-05 07:22:38,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:22:38,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 07:22:38,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:22:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68c397da105ad098382fd HTTP/1.1" 200 None 2026-03-05 07:22:38,518 - lava_callback - ERROR - Error processing callback for node 69a68c397da105ad098382fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:24:18,491 - lava_callback - INFO - Received callback for node 69a68c927da105ad09838305 INFO: 172.21.0.1:60166 - "POST /node/69a68c927da105ad09838305 HTTP/1.0" 202 Accepted 2026-03-05 07:24:18,496 - lava_callback - INFO - Starting async job submit for node 69a68c927da105ad09838305 2026-03-05 07:24:18,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:24:18,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68c927da105ad09838305 HTTP/1.1" 200 None 2026-03-05 07:24:18,512 - lava_callback - DEBUG - Processing node 69a68c927da105ad09838305: baseline-arm64-baylibre 2026-03-05 07:24:18,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68c927da105ad09838305 2026-03-05 07:24:18,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:24:18,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68c927da105ad09838305 HTTP/1.1" 200 None 2026-03-05 07:24:18,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:24:18,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 07:24:18,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:24:18,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68c927da105ad09838305 HTTP/1.1" 200 None 2026-03-05 07:24:18,577 - lava_callback - ERROR - Error processing callback for node 69a68c927da105ad09838305: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:25:38,642 - lava_callback - INFO - Received callback for node 69a68ce97da105ad0983830e INFO: 172.21.0.1:55268 - "POST /node/69a68ce97da105ad0983830e HTTP/1.0" 202 Accepted 2026-03-05 07:25:38,647 - lava_callback - INFO - Starting async job submit for node 69a68ce97da105ad0983830e 2026-03-05 07:25:38,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:25:38,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68ce97da105ad0983830e HTTP/1.1" 200 None 2026-03-05 07:25:38,664 - lava_callback - DEBUG - Processing node 69a68ce97da105ad0983830e: baseline-arm64-baylibre 2026-03-05 07:25:38,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68ce97da105ad0983830e 2026-03-05 07:25:38,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:25:38,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68ce97da105ad0983830e HTTP/1.1" 200 None 2026-03-05 07:25:38,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:25:38,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-05 07:25:38,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:25:38,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68ce97da105ad0983830e HTTP/1.1" 200 None 2026-03-05 07:25:38,730 - lava_callback - ERROR - Error processing callback for node 69a68ce97da105ad0983830e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:31:39,045 - lava_callback - INFO - Received callback for node 69a68e487da105ad09838345 INFO: 172.21.0.1:34734 - "POST /node/69a68e487da105ad09838345 HTTP/1.0" 202 Accepted 2026-03-05 07:31:39,051 - lava_callback - INFO - Starting async job submit for node 69a68e487da105ad09838345 2026-03-05 07:31:39,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:31:39,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68e487da105ad09838345 HTTP/1.1" 200 None 2026-03-05 07:31:39,066 - lava_callback - DEBUG - Processing node 69a68e487da105ad09838345: baseline-arm64-baylibre 2026-03-05 07:31:39,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68e487da105ad09838345 2026-03-05 07:31:39,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:31:39,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68e487da105ad09838345 HTTP/1.1" 200 None 2026-03-05 07:31:39,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:31:39,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 07:31:39,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:31:39,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68e487da105ad09838345 HTTP/1.1" 200 None 2026-03-05 07:31:39,126 - lava_callback - ERROR - Error processing callback for node 69a68e487da105ad09838345: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:32:59,015 - lava_callback - INFO - Received callback for node 69a68ea07da105ad09838350 INFO: 172.21.0.1:52096 - "POST /node/69a68ea07da105ad09838350 HTTP/1.0" 202 Accepted 2026-03-05 07:32:59,021 - lava_callback - INFO - Starting async job submit for node 69a68ea07da105ad09838350 2026-03-05 07:32:59,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:32:59,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68ea07da105ad09838350 HTTP/1.1" 200 None 2026-03-05 07:32:59,037 - lava_callback - DEBUG - Processing node 69a68ea07da105ad09838350: baseline-arm64-baylibre 2026-03-05 07:32:59,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68ea07da105ad09838350 2026-03-05 07:32:59,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:32:59,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68ea07da105ad09838350 HTTP/1.1" 200 None 2026-03-05 07:32:59,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:32:59,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 07:32:59,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:32:59,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68ea07da105ad09838350 HTTP/1.1" 200 None 2026-03-05 07:32:59,103 - lava_callback - ERROR - Error processing callback for node 69a68ea07da105ad09838350: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52354 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:34:19,131 - lava_callback - INFO - Received callback for node 69a68ef87da105ad0983835b INFO: 172.21.0.1:52362 - "POST /node/69a68ef87da105ad0983835b HTTP/1.0" 202 Accepted 2026-03-05 07:34:19,136 - lava_callback - INFO - Starting async job submit for node 69a68ef87da105ad0983835b 2026-03-05 07:34:19,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:34:19,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68ef87da105ad0983835b HTTP/1.1" 200 None 2026-03-05 07:34:19,152 - lava_callback - DEBUG - Processing node 69a68ef87da105ad0983835b: baseline-arm64-baylibre 2026-03-05 07:34:19,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68ef87da105ad0983835b 2026-03-05 07:34:19,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:34:19,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68ef87da105ad0983835b HTTP/1.1" 200 None 2026-03-05 07:34:19,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:34:19,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-05 07:34:19,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:34:19,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68ef87da105ad0983835b HTTP/1.1" 200 None 2026-03-05 07:34:19,207 - lava_callback - ERROR - Error processing callback for node 69a68ef87da105ad0983835b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:35:39,223 - lava_callback - INFO - Received callback for node 69a68f407da105ad0983835f INFO: 172.21.0.1:52026 - "POST /node/69a68f407da105ad0983835f HTTP/1.0" 202 Accepted 2026-03-05 07:35:39,229 - lava_callback - INFO - Starting async job submit for node 69a68f407da105ad0983835f 2026-03-05 07:35:39,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:35:39,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68f407da105ad0983835f HTTP/1.1" 200 None 2026-03-05 07:35:39,248 - lava_callback - DEBUG - Processing node 69a68f407da105ad0983835f: baseline-arm-baylibre 2026-03-05 07:35:39,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68f407da105ad0983835f 2026-03-05 07:35:39,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:35:39,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68f407da105ad0983835f HTTP/1.1" 200 None 2026-03-05 07:35:39,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:35:39,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 07:35:39,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:35:39,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68f407da105ad0983835f HTTP/1.1" 200 None 2026-03-05 07:35:39,313 - lava_callback - ERROR - Error processing callback for node 69a68f407da105ad0983835f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:36:39,143 - lava_callback - INFO - Received callback for node 69a68f727da105ad0983838d INFO: 172.21.0.1:58830 - "POST /node/69a68f727da105ad0983838d HTTP/1.0" 202 Accepted 2026-03-05 07:36:39,149 - lava_callback - INFO - Starting async job submit for node 69a68f727da105ad0983838d 2026-03-05 07:36:39,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:36:39,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68f727da105ad0983838d HTTP/1.1" 200 None 2026-03-05 07:36:39,171 - lava_callback - DEBUG - Processing node 69a68f727da105ad0983838d: baseline-arm-baylibre 2026-03-05 07:36:39,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68f727da105ad0983838d 2026-03-05 07:36:39,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:36:39,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68f727da105ad0983838d HTTP/1.1" 200 None 2026-03-05 07:36:39,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:36:39,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 07:36:39,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:36:39,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68f727da105ad0983838d HTTP/1.1" 200 None 2026-03-05 07:36:39,231 - lava_callback - ERROR - Error processing callback for node 69a68f727da105ad0983838d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45096 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:37:19,257 - lava_callback - INFO - Received callback for node 69a68fa47da105ad0983839f INFO: 172.21.0.1:45108 - "POST /node/69a68fa47da105ad0983839f HTTP/1.0" 202 Accepted 2026-03-05 07:37:19,263 - lava_callback - INFO - Starting async job submit for node 69a68fa47da105ad0983839f 2026-03-05 07:37:19,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:37:19,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68fa47da105ad0983839f HTTP/1.1" 200 None 2026-03-05 07:37:19,279 - lava_callback - DEBUG - Processing node 69a68fa47da105ad0983839f: baseline-arm-baylibre 2026-03-05 07:37:19,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68fa47da105ad0983839f 2026-03-05 07:37:19,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:37:19,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68fa47da105ad0983839f HTTP/1.1" 200 None 2026-03-05 07:37:19,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:37:19,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 07:37:19,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:37:19,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68fa47da105ad0983839f HTTP/1.1" 200 None 2026-03-05 07:37:19,346 - lava_callback - ERROR - Error processing callback for node 69a68fa47da105ad0983839f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:37:59,194 - lava_callback - INFO - Received callback for node 69a68fd47da105ad098383d9 INFO: 172.21.0.1:35534 - "POST /node/69a68fd47da105ad098383d9 HTTP/1.0" 202 Accepted 2026-03-05 07:37:59,204 - lava_callback - INFO - Starting async job submit for node 69a68fd47da105ad098383d9 2026-03-05 07:37:59,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:37:59,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68fd47da105ad098383d9 HTTP/1.1" 200 None 2026-03-05 07:37:59,228 - lava_callback - DEBUG - Processing node 69a68fd47da105ad098383d9: baseline-arm-baylibre 2026-03-05 07:37:59,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a68fd47da105ad098383d9 2026-03-05 07:37:59,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:37:59,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a68fd47da105ad098383d9 HTTP/1.1" 200 None 2026-03-05 07:37:59,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:37:59,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 07:37:59,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:37:59,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a68fd47da105ad098383d9 HTTP/1.1" 200 None 2026-03-05 07:37:59,345 - lava_callback - ERROR - Error processing callback for node 69a68fd47da105ad098383d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:38:59,279 - lava_callback - INFO - Received callback for node 69a690067da105ad09838412 INFO: 172.21.0.1:50786 - "POST /node/69a690067da105ad09838412 HTTP/1.0" 202 Accepted 2026-03-05 07:38:59,284 - lava_callback - INFO - Starting async job submit for node 69a690067da105ad09838412 2026-03-05 07:38:59,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:38:59,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a690067da105ad09838412 HTTP/1.1" 200 None 2026-03-05 07:38:59,333 - lava_callback - DEBUG - Processing node 69a690067da105ad09838412: baseline-arm-baylibre 2026-03-05 07:38:59,334 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a690067da105ad09838412 2026-03-05 07:38:59,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:38:59,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a690067da105ad09838412 HTTP/1.1" 200 None 2026-03-05 07:38:59,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:38:59,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 07:38:59,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:38:59,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a690067da105ad09838412 HTTP/1.1" 200 None 2026-03-05 07:38:59,389 - lava_callback - ERROR - Error processing callback for node 69a690067da105ad09838412: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:39:39,283 - lava_callback - INFO - Received callback for node 69a690377da105ad09838428 INFO: 172.21.0.1:34840 - "POST /node/69a690377da105ad09838428 HTTP/1.0" 202 Accepted 2026-03-05 07:39:39,289 - lava_callback - INFO - Starting async job submit for node 69a690377da105ad09838428 2026-03-05 07:39:39,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:39:39,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a690377da105ad09838428 HTTP/1.1" 200 None 2026-03-05 07:39:39,304 - lava_callback - DEBUG - Processing node 69a690377da105ad09838428: baseline-arm-baylibre 2026-03-05 07:39:39,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a690377da105ad09838428 2026-03-05 07:39:39,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:39:39,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a690377da105ad09838428 HTTP/1.1" 200 None 2026-03-05 07:39:39,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:39:39,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-05 07:39:39,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:39:39,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a690377da105ad09838428 HTTP/1.1" 200 None 2026-03-05 07:39:39,377 - lava_callback - ERROR - Error processing callback for node 69a690377da105ad09838428: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET / HTTP/1.0" 200 OK 2026-03-05 07:59:40,490 - lava_callback - INFO - Received callback for node 69a694e17da105ad09838482 INFO: 172.21.0.1:36502 - "POST /node/69a694e17da105ad09838482 HTTP/1.0" 202 Accepted 2026-03-05 07:59:40,496 - lava_callback - INFO - Starting async job submit for node 69a694e17da105ad09838482 2026-03-05 07:59:40,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:59:40,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a694e17da105ad09838482 HTTP/1.1" 200 None 2026-03-05 07:59:40,512 - lava_callback - DEBUG - Processing node 69a694e17da105ad09838482: baseline-arm-baylibre 2026-03-05 07:59:40,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a694e17da105ad09838482 2026-03-05 07:59:40,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:59:40,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a694e17da105ad09838482 HTTP/1.1" 200 None 2026-03-05 07:59:40,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:59:40,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 07:59:40,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 07:59:40,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a694e17da105ad09838482 HTTP/1.1" 200 None 2026-03-05 07:59:40,612 - lava_callback - ERROR - Error processing callback for node 69a694e17da105ad09838482: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK 2026-03-05 08:00:40,398 - lava_callback - INFO - Received callback for node 69a6951e7da105ad0983848e INFO: 172.21.0.1:34248 - "POST /node/69a6951e7da105ad0983848e HTTP/1.0" 202 Accepted 2026-03-05 08:00:40,403 - lava_callback - INFO - Starting async job submit for node 69a6951e7da105ad0983848e 2026-03-05 08:00:40,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:00:40,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6951e7da105ad0983848e HTTP/1.1" 200 None 2026-03-05 08:00:40,425 - lava_callback - DEBUG - Processing node 69a6951e7da105ad0983848e: baseline-arm-baylibre 2026-03-05 08:00:40,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6951e7da105ad0983848e 2026-03-05 08:00:40,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:00:40,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6951e7da105ad0983848e HTTP/1.1" 200 None 2026-03-05 08:00:40,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:00:40,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 08:00:40,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:00:40,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6951e7da105ad0983848e HTTP/1.1" 200 None 2026-03-05 08:00:40,480 - lava_callback - ERROR - Error processing callback for node 69a6951e7da105ad0983848e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK 2026-03-05 08:01:40,538 - lava_callback - INFO - Received callback for node 69a6955a7da105ad0983849a INFO: 172.21.0.1:33046 - "POST /node/69a6955a7da105ad0983849a HTTP/1.0" 202 Accepted 2026-03-05 08:01:40,544 - lava_callback - INFO - Starting async job submit for node 69a6955a7da105ad0983849a 2026-03-05 08:01:40,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:01:40,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6955a7da105ad0983849a HTTP/1.1" 200 None 2026-03-05 08:01:40,561 - lava_callback - DEBUG - Processing node 69a6955a7da105ad0983849a: baseline-arm-baylibre 2026-03-05 08:01:40,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a6955a7da105ad0983849a 2026-03-05 08:01:40,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:01:40,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6955a7da105ad0983849a HTTP/1.1" 200 None 2026-03-05 08:01:40,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:01:40,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 08:01:40,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:01:40,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a6955a7da105ad0983849a HTTP/1.1" 200 None 2026-03-05 08:01:40,616 - lava_callback - ERROR - Error processing callback for node 69a6955a7da105ad0983849a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET / HTTP/1.0" 200 OK 2026-03-05 08:02:40,541 - lava_callback - INFO - Received callback for node 69a695977da105ad098384a8 INFO: 172.21.0.1:35868 - "POST /node/69a695977da105ad098384a8 HTTP/1.0" 202 Accepted 2026-03-05 08:02:40,547 - lava_callback - INFO - Starting async job submit for node 69a695977da105ad098384a8 2026-03-05 08:02:40,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:02:40,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a695977da105ad098384a8 HTTP/1.1" 200 None 2026-03-05 08:02:40,576 - lava_callback - DEBUG - Processing node 69a695977da105ad098384a8: baseline-arm-baylibre 2026-03-05 08:02:40,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a695977da105ad098384a8 2026-03-05 08:02:40,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:02:40,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a695977da105ad098384a8 HTTP/1.1" 200 None 2026-03-05 08:02:40,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:02:40,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 08:02:40,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:02:40,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a695977da105ad098384a8 HTTP/1.1" 200 None 2026-03-05 08:02:40,636 - lava_callback - ERROR - Error processing callback for node 69a695977da105ad098384a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK 2026-03-05 08:03:40,609 - lava_callback - INFO - Received callback for node 69a695ca7da105ad098384b3 INFO: 172.21.0.1:48006 - "POST /node/69a695ca7da105ad098384b3 HTTP/1.0" 202 Accepted 2026-03-05 08:03:40,618 - lava_callback - INFO - Starting async job submit for node 69a695ca7da105ad098384b3 2026-03-05 08:03:40,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:03:40,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a695ca7da105ad098384b3 HTTP/1.1" 200 None 2026-03-05 08:03:40,642 - lava_callback - DEBUG - Processing node 69a695ca7da105ad098384b3: baseline-arm-baylibre 2026-03-05 08:03:40,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a695ca7da105ad098384b3 2026-03-05 08:03:40,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:03:40,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a695ca7da105ad098384b3 HTTP/1.1" 200 None 2026-03-05 08:03:40,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:03:40,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-05 08:03:40,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-05 08:03:40,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a695ca7da105ad098384b3 HTTP/1.1" 200 None 2026-03-05 08:03:40,700 - lava_callback - ERROR - Error processing callback for node 69a695ca7da105ad098384b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]