INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39800 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:26:18,877 - lava_callback - INFO - Received callback for node 69fa8aa0e18d38d4ebffe756 2026-05-08 00:26:18,883 - lava_callback - INFO - Starting async job submit for node 69fa8aa0e18d38d4ebffe756 INFO: 172.20.0.1:39810 - "POST /node/69fa8aa0e18d38d4ebffe756 HTTP/1.0" 202 Accepted 2026-05-08 00:26:18,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:26:18,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8aa0e18d38d4ebffe756 HTTP/1.1" 200 None 2026-05-08 00:26:18,904 - lava_callback - DEBUG - Processing node 69fa8aa0e18d38d4ebffe756: baseline-arm64-baylibre 2026-05-08 00:26:18,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8aa0e18d38d4ebffe756 2026-05-08 00:26:18,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:26:18,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8aa0e18d38d4ebffe756 HTTP/1.1" 200 None 2026-05-08 00:26:18,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:26:18,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-08 00:26:18,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:26:18,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8aa0e18d38d4ebffe756 HTTP/1.1" 200 None 2026-05-08 00:26:18,954 - lava_callback - ERROR - Error processing callback for node 69fa8aa0e18d38d4ebffe756: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53698 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 00:28:16,166 - lava_callback - INFO - Received callback for node 69fa8b1de18d38d4eb000e62 INFO: 172.20.0.1:53710 - "POST /node/69fa8b1de18d38d4eb000e62 HTTP/1.0" 202 Accepted 2026-05-08 00:28:16,172 - lava_callback - INFO - Starting async job submit for node 69fa8b1de18d38d4eb000e62 2026-05-08 00:28:16,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:28:16,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8b1de18d38d4eb000e62 HTTP/1.1" 200 None 2026-05-08 00:28:16,188 - lava_callback - DEBUG - Processing node 69fa8b1de18d38d4eb000e62: baseline-arm64-clabbe 2026-05-08 00:28:16,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8b1de18d38d4eb000e62 2026-05-08 00:28:16,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:28:16,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8b1de18d38d4eb000e62 HTTP/1.1" 200 None 2026-05-08 00:28:16,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:28:16,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-08 00:28:16,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:28:16,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8b1de18d38d4eb000e62 HTTP/1.1" 200 None 2026-05-08 00:28:16,237 - lava_callback - ERROR - Error processing callback for node 69fa8b1de18d38d4eb000e62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56452 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:29:36,194 - lava_callback - INFO - Received callback for node 69fa8b6ae18d38d4eb000e8d INFO: 172.20.0.1:56464 - "POST /node/69fa8b6ae18d38d4eb000e8d HTTP/1.0" 202 Accepted 2026-05-08 00:29:36,201 - lava_callback - INFO - Starting async job submit for node 69fa8b6ae18d38d4eb000e8d 2026-05-08 00:29:36,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:29:36,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8b6ae18d38d4eb000e8d HTTP/1.1" 200 None 2026-05-08 00:29:36,221 - lava_callback - DEBUG - Processing node 69fa8b6ae18d38d4eb000e8d: baseline-arm64-clabbe 2026-05-08 00:29:36,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8b6ae18d38d4eb000e8d 2026-05-08 00:29:36,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:29:36,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8b6ae18d38d4eb000e8d HTTP/1.1" 200 None 2026-05-08 00:29:36,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:29:36,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-08 00:29:36,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:29:36,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8b6ae18d38d4eb000e8d HTTP/1.1" 200 None 2026-05-08 00:29:36,280 - lava_callback - ERROR - Error processing callback for node 69fa8b6ae18d38d4eb000e8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:32:36,428 - lava_callback - INFO - Received callback for node 69fa8c0ee18d38d4eb000ebb INFO: 172.20.0.1:41810 - "POST /node/69fa8c0ee18d38d4eb000ebb HTTP/1.0" 202 Accepted 2026-05-08 00:32:36,433 - lava_callback - INFO - Starting async job submit for node 69fa8c0ee18d38d4eb000ebb 2026-05-08 00:32:36,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:32:36,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8c0ee18d38d4eb000ebb HTTP/1.1" 200 None 2026-05-08 00:32:36,456 - lava_callback - DEBUG - Processing node 69fa8c0ee18d38d4eb000ebb: baseline-arm64-clabbe 2026-05-08 00:32:36,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8c0ee18d38d4eb000ebb 2026-05-08 00:32:36,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:32:36,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8c0ee18d38d4eb000ebb HTTP/1.1" 200 None 2026-05-08 00:32:36,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:32:36,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-08 00:32:36,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:41818 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:32:36,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8c0ee18d38d4eb000ebb HTTP/1.1" 200 None 2026-05-08 00:32:36,522 - lava_callback - ERROR - Error processing callback for node 69fa8c0ee18d38d4eb000ebb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:34:56,400 - lava_callback - INFO - Received callback for node 69fa8c9ee18d38d4eb000f25 INFO: 172.20.0.1:54612 - "POST /node/69fa8c9ee18d38d4eb000f25 HTTP/1.0" 202 Accepted 2026-05-08 00:34:56,406 - lava_callback - INFO - Starting async job submit for node 69fa8c9ee18d38d4eb000f25 2026-05-08 00:34:56,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:34:56,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8c9ee18d38d4eb000f25 HTTP/1.1" 200 None 2026-05-08 00:34:56,429 - lava_callback - DEBUG - Processing node 69fa8c9ee18d38d4eb000f25: baseline-arm64-clabbe 2026-05-08 00:34:56,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8c9ee18d38d4eb000f25 2026-05-08 00:34:56,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:34:56,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8c9ee18d38d4eb000f25 HTTP/1.1" 200 None 2026-05-08 00:34:56,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:34:56,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-08 00:34:56,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:34:56,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8c9ee18d38d4eb000f25 HTTP/1.1" 200 None 2026-05-08 00:34:56,488 - lava_callback - ERROR - Error processing callback for node 69fa8c9ee18d38d4eb000f25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37428 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:36:16,530 - lava_callback - INFO - Received callback for node 69fa8cebe18d38d4eb000f4e INFO: 172.20.0.1:37434 - "POST /node/69fa8cebe18d38d4eb000f4e HTTP/1.0" 202 Accepted 2026-05-08 00:36:16,535 - lava_callback - INFO - Starting async job submit for node 69fa8cebe18d38d4eb000f4e 2026-05-08 00:36:16,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:36:16,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8cebe18d38d4eb000f4e HTTP/1.1" 200 None 2026-05-08 00:36:16,569 - lava_callback - DEBUG - Processing node 69fa8cebe18d38d4eb000f4e: baseline-arm64-clabbe 2026-05-08 00:36:16,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8cebe18d38d4eb000f4e 2026-05-08 00:36:16,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:36:16,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8cebe18d38d4eb000f4e HTTP/1.1" 200 None 2026-05-08 00:36:16,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:36:16,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-08 00:36:16,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:36:16,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8cebe18d38d4eb000f4e HTTP/1.1" 200 None 2026-05-08 00:36:16,690 - lava_callback - ERROR - Error processing callback for node 69fa8cebe18d38d4eb000f4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40186 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:38:36,589 - lava_callback - INFO - Received callback for node 69fa8d7be18d38d4eb000f88 INFO: 172.20.0.1:40196 - "POST /node/69fa8d7be18d38d4eb000f88 HTTP/1.0" 202 Accepted 2026-05-08 00:38:36,599 - lava_callback - INFO - Starting async job submit for node 69fa8d7be18d38d4eb000f88 2026-05-08 00:38:36,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:36,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8d7be18d38d4eb000f88 HTTP/1.1" 200 None 2026-05-08 00:38:36,631 - lava_callback - DEBUG - Processing node 69fa8d7be18d38d4eb000f88: baseline-arm64-clabbe 2026-05-08 00:38:36,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8d7be18d38d4eb000f88 2026-05-08 00:38:36,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:36,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8d7be18d38d4eb000f88 HTTP/1.1" 200 None 2026-05-08 00:38:36,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:36,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-08 00:38:36,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:36,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8d7be18d38d4eb000f88 HTTP/1.1" 200 None 2026-05-08 00:38:36,722 - lava_callback - ERROR - Error processing callback for node 69fa8d7be18d38d4eb000f88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34932 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:38:47,302 - lava_callback - INFO - Received callback for node 69fd3011197af08e45fc5512 INFO: 172.20.0.1:34938 - "POST /node/69fd3011197af08e45fc5512 HTTP/1.0" 202 Accepted 2026-05-08 00:38:47,308 - lava_callback - INFO - Starting async job submit for node 69fd3011197af08e45fc5512 2026-05-08 00:38:47,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:47,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3011197af08e45fc5512 HTTP/1.1" 200 None 2026-05-08 00:38:47,345 - lava_callback - DEBUG - Processing node 69fd3011197af08e45fc5512: baseline-arm 2026-05-08 00:38:47,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:38:47,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:38:47,624 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3011197af08e45fc5512/log.txt.gz 2026-05-08 00:38:47,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:38:47,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:38:47,852 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3011197af08e45fc5512/lava-logs.yaml 2026-05-08 00:38:47,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:38:47,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:38:47,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3011197af08e45fc5512/lava_callback.json.gz 2026-05-08 00:38:47,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:47,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3011197af08e45fc5512 HTTP/1.1" 200 None 2026-05-08 00:38:47,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:47,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf7197af08e45fc2dd5 HTTP/1.1" 200 None 2026-05-08 00:38:47,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:48,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3011197af08e45fc5512 HTTP/1.1" 200 None 2026-05-08 00:38:48,021 - lava_callback - INFO - Completed processing callback for node 69fd3011197af08e45fc5512 2026-05-08 00:38:48,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:38:48,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47466 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:39:38,533 - lava_callback - INFO - Received callback for node 69fd30a8197af08e45fc5530 INFO: 172.20.0.1:47472 - "POST /node/69fd30a8197af08e45fc5530 HTTP/1.0" 202 Accepted 2026-05-08 00:39:38,542 - lava_callback - INFO - Starting async job submit for node 69fd30a8197af08e45fc5530 2026-05-08 00:39:38,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:38,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30a8197af08e45fc5530 HTTP/1.1" 200 None 2026-05-08 00:39:38,581 - lava_callback - DEBUG - Processing node 69fd30a8197af08e45fc5530: baseline-x86 2026-05-08 00:39:38,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:39:38,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:39:38,881 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a8197af08e45fc5530/log.txt.gz 2026-05-08 00:39:39,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:39:39,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:39:39,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a8197af08e45fc5530/lava-logs.yaml 2026-05-08 00:39:39,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:39:39,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:39:39,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a8197af08e45fc5530/lava_callback.json.gz 2026-05-08 00:39:39,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:39,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30a8197af08e45fc5530 HTTP/1.1" 200 None 2026-05-08 00:39:39,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:39,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2c15197af08e45fc2df8 HTTP/1.1" 200 None 2026-05-08 00:39:39,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:39,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd30a8197af08e45fc5530 HTTP/1.1" 200 None 2026-05-08 00:39:39,400 - lava_callback - INFO - Completed processing callback for node 69fd30a8197af08e45fc5530 2026-05-08 00:39:41,266 - lava_callback - INFO - Received callback for node 69fd30aa197af08e45fc5539 INFO: 172.20.0.1:43868 - "POST /node/69fd30aa197af08e45fc5539 HTTP/1.0" 202 Accepted 2026-05-08 00:39:41,272 - lava_callback - INFO - Starting async job submit for node 69fd30aa197af08e45fc5539 2026-05-08 00:39:41,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:41,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30aa197af08e45fc5539 HTTP/1.1" 200 None 2026-05-08 00:39:41,304 - lava_callback - DEBUG - Processing node 69fd30aa197af08e45fc5539: baseline-x86 2026-05-08 00:39:41,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:39:41,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:39:41,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30aa197af08e45fc5539/log.txt.gz 2026-05-08 00:39:41,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:39:41,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:39:41,882 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30aa197af08e45fc5539/lava-logs.yaml 2026-05-08 00:39:41,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:39:41,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:39:41,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30aa197af08e45fc5539/lava_callback.json.gz 2026-05-08 00:39:41,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:42,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30aa197af08e45fc5539 HTTP/1.1" 200 None 2026-05-08 00:39:42,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:42,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2c15197af08e45fc2df8 HTTP/1.1" 200 None 2026-05-08 00:39:42,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:42,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd30aa197af08e45fc5539 HTTP/1.1" 200 None 2026-05-08 00:39:42,065 - lava_callback - INFO - Completed processing callback for node 69fd30aa197af08e45fc5539 INFO: 172.20.0.1:43870 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:39:48,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:39:49,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50076 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:40:18,281 - lava_callback - INFO - Received callback for node 69fd30a9197af08e45fc5536 INFO: 172.20.0.1:50084 - "POST /node/69fd30a9197af08e45fc5536 HTTP/1.0" 202 Accepted 2026-05-08 00:40:18,287 - lava_callback - INFO - Starting async job submit for node 69fd30a9197af08e45fc5536 2026-05-08 00:40:18,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:18,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30a9197af08e45fc5536 HTTP/1.1" 200 None 2026-05-08 00:40:18,373 - lava_callback - DEBUG - Processing node 69fd30a9197af08e45fc5536: baseline-x86 2026-05-08 00:40:18,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:40:18,803 - lava_callback - INFO - Received callback for node 69fd30a9197af08e45fc5533 2026-05-08 00:40:18,809 - lava_callback - INFO - Starting async job submit for node 69fd30a9197af08e45fc5533 INFO: 172.20.0.1:50088 - "POST /node/69fd30a9197af08e45fc5533 HTTP/1.0" 202 Accepted 2026-05-08 00:40:18,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:18,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30a9197af08e45fc5533 HTTP/1.1" 200 None 2026-05-08 00:40:18,871 - lava_callback - DEBUG - Processing node 69fd30a9197af08e45fc5533: baseline-x86 2026-05-08 00:40:18,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:40:19,000 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a9197af08e45fc5536/log.txt.gz 2026-05-08 00:40:19,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:40:19,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:40:19,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:40:19,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a9197af08e45fc5533/log.txt.gz 2026-05-08 00:40:19,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:40:19,582 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a9197af08e45fc5536/lava-logs.yaml 2026-05-08 00:40:19,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:40:19,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:40:19,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:40:19,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a9197af08e45fc5536/lava_callback.json.gz 2026-05-08 00:40:19,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:19,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30a9197af08e45fc5536 HTTP/1.1" 200 None 2026-05-08 00:40:19,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:19,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2c15197af08e45fc2df8 HTTP/1.1" 200 None 2026-05-08 00:40:19,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:19,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:40:19,904 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a9197af08e45fc5533/lava-logs.yaml 2026-05-08 00:40:19,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd30a9197af08e45fc5536 HTTP/1.1" 200 None 2026-05-08 00:40:19,917 - lava_callback - INFO - Completed processing callback for node 69fd30a9197af08e45fc5536 2026-05-08 00:40:19,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:40:20,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:40:20,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30a9197af08e45fc5533/lava_callback.json.gz 2026-05-08 00:40:20,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:20,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30a9197af08e45fc5533 HTTP/1.1" 200 None 2026-05-08 00:40:20,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:20,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2c15197af08e45fc2df8 HTTP/1.1" 200 None 2026-05-08 00:40:20,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:20,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd30a9197af08e45fc5533 HTTP/1.1" 200 None 2026-05-08 00:40:20,156 - lava_callback - INFO - Completed processing callback for node 69fd30a9197af08e45fc5533 INFO: 172.20.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47742 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:40:49,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:40:49,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41816 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:41:00,082 - lava_callback - INFO - Received callback for node 69fd30ab197af08e45fc553c INFO: 172.20.0.1:34282 - "POST /node/69fd30ab197af08e45fc553c HTTP/1.0" 202 Accepted 2026-05-08 00:41:00,092 - lava_callback - INFO - Starting async job submit for node 69fd30ab197af08e45fc553c 2026-05-08 00:41:00,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:00,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30ab197af08e45fc553c HTTP/1.1" 200 None 2026-05-08 00:41:00,170 - lava_callback - DEBUG - Processing node 69fd30ab197af08e45fc553c: baseline-x86 2026-05-08 00:41:00,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:41:00,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:41:00,603 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30ab197af08e45fc553c/log.txt.gz 2026-05-08 00:41:00,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:41:00,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:41:00,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30ab197af08e45fc553c/lava-logs.yaml 2026-05-08 00:41:00,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:41:00,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:41:01,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fd30ab197af08e45fc553c/lava_callback.json.gz 2026-05-08 00:41:01,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:01,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd30ab197af08e45fc553c HTTP/1.1" 200 None 2026-05-08 00:41:01,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:01,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2c15197af08e45fc2df8 HTTP/1.1" 200 None 2026-05-08 00:41:01,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:01,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd30ab197af08e45fc553c HTTP/1.1" 200 None 2026-05-08 00:41:01,083 - lava_callback - INFO - Completed processing callback for node 69fd30ab197af08e45fc553c INFO: 172.20.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43242 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:41:19,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:19,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51518 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:41:39,781 - lava_callback - INFO - Received callback for node 69fa8e41e18d38d4eb000fc5 INFO: 172.20.0.1:45076 - "POST /node/69fa8e41e18d38d4eb000fc5 HTTP/1.0" 202 Accepted 2026-05-08 00:41:39,790 - lava_callback - INFO - Starting async job submit for node 69fa8e41e18d38d4eb000fc5 2026-05-08 00:41:39,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:39,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e41e18d38d4eb000fc5 HTTP/1.1" 200 None 2026-05-08 00:41:39,857 - lava_callback - DEBUG - Processing node 69fa8e41e18d38d4eb000fc5: baseline-arm-baylibre 2026-05-08 00:41:39,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e41e18d38d4eb000fc5 2026-05-08 00:41:39,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:39,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e41e18d38d4eb000fc5 HTTP/1.1" 200 None 2026-05-08 00:41:39,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:39,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:41:39,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:39,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e41e18d38d4eb000fc5 HTTP/1.1" 200 None 2026-05-08 00:41:39,933 - lava_callback - ERROR - Error processing callback for node 69fa8e41e18d38d4eb000fc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58876 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:41:56,657 - lava_callback - INFO - Received callback for node 69fa8e4ce18d38d4eb001002 INFO: 172.20.0.1:58892 - "POST /node/69fa8e4ce18d38d4eb001002 HTTP/1.0" 202 Accepted 2026-05-08 00:41:56,664 - lava_callback - INFO - Starting async job submit for node 69fa8e4ce18d38d4eb001002 2026-05-08 00:41:56,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:56,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e4ce18d38d4eb001002 HTTP/1.1" 200 None 2026-05-08 00:41:56,687 - lava_callback - DEBUG - Processing node 69fa8e4ce18d38d4eb001002: baseline-arm-clabbe 2026-05-08 00:41:56,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e4ce18d38d4eb001002 2026-05-08 00:41:56,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:56,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e4ce18d38d4eb001002 HTTP/1.1" 200 None 2026-05-08 00:41:56,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:56,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:41:56,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:56,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e4ce18d38d4eb001002 HTTP/1.1" 200 None 2026-05-08 00:41:56,738 - lava_callback - ERROR - Error processing callback for node 69fa8e4ce18d38d4eb001002: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:41:57,303 - lava_callback - INFO - Received callback for node 69fa8e51e18d38d4eb001019 INFO: 172.20.0.1:58900 - "POST /node/69fa8e51e18d38d4eb001019 HTTP/1.0" 202 Accepted 2026-05-08 00:41:57,312 - lava_callback - INFO - Starting async job submit for node 69fa8e51e18d38d4eb001019 2026-05-08 00:41:57,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:57,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e51e18d38d4eb001019 HTTP/1.1" 200 None 2026-05-08 00:41:57,340 - lava_callback - DEBUG - Processing node 69fa8e51e18d38d4eb001019: baseline-arm-clabbe 2026-05-08 00:41:57,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e51e18d38d4eb001019 2026-05-08 00:41:57,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:57,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e51e18d38d4eb001019 HTTP/1.1" 200 None 2026-05-08 00:41:57,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:57,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:41:57,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:57,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e51e18d38d4eb001019 HTTP/1.1" 200 None 2026-05-08 00:41:57,453 - lava_callback - ERROR - Error processing callback for node 69fa8e51e18d38d4eb001019: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:41:59,669 - lava_callback - INFO - Received callback for node 69fa8e42e18d38d4eb000fc8 INFO: 172.20.0.1:58910 - "POST /node/69fa8e42e18d38d4eb000fc8 HTTP/1.0" 202 Accepted 2026-05-08 00:41:59,675 - lava_callback - INFO - Starting async job submit for node 69fa8e42e18d38d4eb000fc8 2026-05-08 00:41:59,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:59,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e42e18d38d4eb000fc8 HTTP/1.1" 200 None 2026-05-08 00:41:59,692 - lava_callback - DEBUG - Processing node 69fa8e42e18d38d4eb000fc8: baseline-arm-baylibre 2026-05-08 00:41:59,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e42e18d38d4eb000fc8 2026-05-08 00:41:59,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:59,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e42e18d38d4eb000fc8 HTTP/1.1" 200 None 2026-05-08 00:41:59,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:59,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:41:59,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:41:59,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e42e18d38d4eb000fc8 HTTP/1.1" 200 None 2026-05-08 00:41:59,751 - lava_callback - ERROR - Error processing callback for node 69fa8e42e18d38d4eb000fc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:42:00,332 - lava_callback - INFO - Received callback for node 69fa8e44e18d38d4eb000fcb INFO: 172.20.0.1:57440 - "POST /node/69fa8e44e18d38d4eb000fcb HTTP/1.0" 202 Accepted 2026-05-08 00:42:00,341 - lava_callback - INFO - Starting async job submit for node 69fa8e44e18d38d4eb000fcb 2026-05-08 00:42:00,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:00,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e44e18d38d4eb000fcb HTTP/1.1" 200 None 2026-05-08 00:42:00,360 - lava_callback - DEBUG - Processing node 69fa8e44e18d38d4eb000fcb: baseline-arm-baylibre 2026-05-08 00:42:00,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e44e18d38d4eb000fcb 2026-05-08 00:42:00,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:00,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e44e18d38d4eb000fcb HTTP/1.1" 200 None 2026-05-08 00:42:00,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:00,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:00,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:00,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e44e18d38d4eb000fcb HTTP/1.1" 200 None 2026-05-08 00:42:00,421 - lava_callback - ERROR - Error processing callback for node 69fa8e44e18d38d4eb000fcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:42:00,990 - lava_callback - INFO - Received callback for node 69fa8e45e18d38d4eb000fd0 INFO: 172.20.0.1:57456 - "POST /node/69fa8e45e18d38d4eb000fd0 HTTP/1.0" 202 Accepted 2026-05-08 00:42:00,998 - lava_callback - INFO - Starting async job submit for node 69fa8e45e18d38d4eb000fd0 2026-05-08 00:42:00,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:01,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e45e18d38d4eb000fd0 HTTP/1.1" 200 None 2026-05-08 00:42:01,026 - lava_callback - DEBUG - Processing node 69fa8e45e18d38d4eb000fd0: baseline-arm-baylibre 2026-05-08 00:42:01,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e45e18d38d4eb000fd0 2026-05-08 00:42:01,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:01,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e45e18d38d4eb000fd0 HTTP/1.1" 200 None 2026-05-08 00:42:01,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:01,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:01,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:01,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e45e18d38d4eb000fd0 HTTP/1.1" 200 None 2026-05-08 00:42:01,111 - lava_callback - ERROR - Error processing callback for node 69fa8e45e18d38d4eb000fd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:42:01,634 - lava_callback - INFO - Received callback for node 69fa8e49e18d38d4eb000fdf INFO: 172.20.0.1:57460 - "POST /node/69fa8e49e18d38d4eb000fdf HTTP/1.0" 202 Accepted 2026-05-08 00:42:01,641 - lava_callback - INFO - Starting async job submit for node 69fa8e49e18d38d4eb000fdf 2026-05-08 00:42:01,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:01,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e49e18d38d4eb000fdf HTTP/1.1" 200 None 2026-05-08 00:42:01,662 - lava_callback - DEBUG - Processing node 69fa8e49e18d38d4eb000fdf: baseline-arm-baylibre 2026-05-08 00:42:01,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e49e18d38d4eb000fdf 2026-05-08 00:42:01,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:01,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e49e18d38d4eb000fdf HTTP/1.1" 200 None 2026-05-08 00:42:01,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:01,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:01,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:01,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e49e18d38d4eb000fdf HTTP/1.1" 200 None 2026-05-08 00:42:01,720 - lava_callback - ERROR - Error processing callback for node 69fa8e49e18d38d4eb000fdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:42:02,282 - lava_callback - INFO - Received callback for node 69fa8e4ae18d38d4eb000fe6 INFO: 172.20.0.1:57468 - "POST /node/69fa8e4ae18d38d4eb000fe6 HTTP/1.0" 202 Accepted 2026-05-08 00:42:02,291 - lava_callback - INFO - Starting async job submit for node 69fa8e4ae18d38d4eb000fe6 2026-05-08 00:42:02,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:02,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e4ae18d38d4eb000fe6 HTTP/1.1" 200 None 2026-05-08 00:42:02,324 - lava_callback - DEBUG - Processing node 69fa8e4ae18d38d4eb000fe6: baseline-arm-baylibre 2026-05-08 00:42:02,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e4ae18d38d4eb000fe6 2026-05-08 00:42:02,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:02,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e4ae18d38d4eb000fe6 HTTP/1.1" 200 None 2026-05-08 00:42:02,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:02,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:02,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:02,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e4ae18d38d4eb000fe6 HTTP/1.1" 200 None 2026-05-08 00:42:02,421 - lava_callback - ERROR - Error processing callback for node 69fa8e4ae18d38d4eb000fe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43084 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:42:16,642 - lava_callback - INFO - Received callback for node 69fa8e55e18d38d4eb001027 INFO: 172.20.0.1:43100 - "POST /node/69fa8e55e18d38d4eb001027 HTTP/1.0" 202 Accepted 2026-05-08 00:42:16,649 - lava_callback - INFO - Starting async job submit for node 69fa8e55e18d38d4eb001027 2026-05-08 00:42:16,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:16,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e55e18d38d4eb001027 HTTP/1.1" 200 None 2026-05-08 00:42:16,666 - lava_callback - DEBUG - Processing node 69fa8e55e18d38d4eb001027: baseline-arm-clabbe 2026-05-08 00:42:16,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e55e18d38d4eb001027 2026-05-08 00:42:16,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:16,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e55e18d38d4eb001027 HTTP/1.1" 200 None 2026-05-08 00:42:16,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:16,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:16,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:16,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e55e18d38d4eb001027 HTTP/1.1" 200 None 2026-05-08 00:42:16,739 - lava_callback - ERROR - Error processing callback for node 69fa8e55e18d38d4eb001027: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:42:17,301 - lava_callback - INFO - Received callback for node 69fa8e56e18d38d4eb00102a INFO: 172.20.0.1:43104 - "POST /node/69fa8e56e18d38d4eb00102a HTTP/1.0" 202 Accepted 2026-05-08 00:42:17,309 - lava_callback - INFO - Starting async job submit for node 69fa8e56e18d38d4eb00102a 2026-05-08 00:42:17,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:17,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e56e18d38d4eb00102a HTTP/1.1" 200 None 2026-05-08 00:42:17,332 - lava_callback - DEBUG - Processing node 69fa8e56e18d38d4eb00102a: baseline-arm-clabbe 2026-05-08 00:42:17,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e56e18d38d4eb00102a 2026-05-08 00:42:17,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:17,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e56e18d38d4eb00102a HTTP/1.1" 200 None 2026-05-08 00:42:17,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:17,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:17,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:17,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e56e18d38d4eb00102a HTTP/1.1" 200 None 2026-05-08 00:42:17,408 - lava_callback - ERROR - Error processing callback for node 69fa8e56e18d38d4eb00102a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:42:17,939 - lava_callback - INFO - Received callback for node 69fa8e56e18d38d4eb00102d INFO: 172.20.0.1:43106 - "POST /node/69fa8e56e18d38d4eb00102d HTTP/1.0" 202 Accepted 2026-05-08 00:42:17,949 - lava_callback - INFO - Starting async job submit for node 69fa8e56e18d38d4eb00102d 2026-05-08 00:42:17,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:17,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e56e18d38d4eb00102d HTTP/1.1" 200 None 2026-05-08 00:42:17,977 - lava_callback - DEBUG - Processing node 69fa8e56e18d38d4eb00102d: baseline-arm-clabbe 2026-05-08 00:42:17,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e56e18d38d4eb00102d 2026-05-08 00:42:17,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:17,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e56e18d38d4eb00102d HTTP/1.1" 200 None 2026-05-08 00:42:17,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:18,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:18,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:18,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e56e18d38d4eb00102d HTTP/1.1" 200 None 2026-05-08 00:42:18,072 - lava_callback - ERROR - Error processing callback for node 69fa8e56e18d38d4eb00102d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:42:18,643 - lava_callback - INFO - Received callback for node 69fa8e57e18d38d4eb001030 INFO: 172.20.0.1:43108 - "POST /node/69fa8e57e18d38d4eb001030 HTTP/1.0" 202 Accepted 2026-05-08 00:42:18,650 - lava_callback - INFO - Starting async job submit for node 69fa8e57e18d38d4eb001030 2026-05-08 00:42:18,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:18,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e57e18d38d4eb001030 HTTP/1.1" 200 None 2026-05-08 00:42:18,675 - lava_callback - DEBUG - Processing node 69fa8e57e18d38d4eb001030: baseline-arm-clabbe 2026-05-08 00:42:18,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e57e18d38d4eb001030 2026-05-08 00:42:18,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:18,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e57e18d38d4eb001030 HTTP/1.1" 200 None 2026-05-08 00:42:18,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:18,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:18,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:18,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e57e18d38d4eb001030 HTTP/1.1" 200 None 2026-05-08 00:42:18,737 - lava_callback - ERROR - Error processing callback for node 69fa8e57e18d38d4eb001030: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:42:19,300 - lava_callback - INFO - Received callback for node 69fa8e59e18d38d4eb001039 INFO: 172.20.0.1:43112 - "POST /node/69fa8e59e18d38d4eb001039 HTTP/1.0" 202 Accepted 2026-05-08 00:42:19,306 - lava_callback - INFO - Starting async job submit for node 69fa8e59e18d38d4eb001039 2026-05-08 00:42:19,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:19,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e59e18d38d4eb001039 HTTP/1.1" 200 None 2026-05-08 00:42:19,335 - lava_callback - DEBUG - Processing node 69fa8e59e18d38d4eb001039: baseline-arm-clabbe 2026-05-08 00:42:19,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e59e18d38d4eb001039 2026-05-08 00:42:19,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:19,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e59e18d38d4eb001039 HTTP/1.1" 200 None 2026-05-08 00:42:19,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:19,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 00:42:19,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:19,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e59e18d38d4eb001039 HTTP/1.1" 200 None 2026-05-08 00:42:19,491 - lava_callback - ERROR - Error processing callback for node 69fa8e59e18d38d4eb001039: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60682 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:42:53,006 - lava_callback - INFO - Received callback for node 69fd317f197af08e45fc55c4 INFO: 172.20.0.1:46322 - "POST /node/69fd317f197af08e45fc55c4 HTTP/1.0" 202 Accepted 2026-05-08 00:42:53,011 - lava_callback - INFO - Starting async job submit for node 69fd317f197af08e45fc55c4 2026-05-08 00:42:53,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:53,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd317f197af08e45fc55c4 HTTP/1.1" 200 None 2026-05-08 00:42:53,029 - lava_callback - DEBUG - Processing node 69fd317f197af08e45fc55c4: baseline-arm 2026-05-08 00:42:53,034 - lava_callback - WARNING - Failed to upload log 2026-05-08 00:42:53,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:42:53,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:42:53,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd317f197af08e45fc55c4/lava-logs.yaml 2026-05-08 00:42:53,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:42:53,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:42:53,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd317f197af08e45fc55c4/lava_callback.json.gz 2026-05-08 00:42:53,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:53,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd317f197af08e45fc55c4 HTTP/1.1" 200 None 2026-05-08 00:42:53,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:53,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:42:53,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:42:53,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd317f197af08e45fc55c4 HTTP/1.1" 200 None 2026-05-08 00:42:53,263 - lava_callback - INFO - Completed processing callback for node 69fd317f197af08e45fc55c4 INFO: 172.20.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37128 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:43:14,344 - lava_callback - INFO - Received callback for node 69fd3182197af08e45fc55d1 INFO: 172.20.0.1:40358 - "POST /node/69fd3182197af08e45fc55d1 HTTP/1.0" 202 Accepted 2026-05-08 00:43:14,394 - lava_callback - INFO - Starting async job submit for node 69fd3182197af08e45fc55d1 2026-05-08 00:43:14,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:14,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3182197af08e45fc55d1 HTTP/1.1" 200 None 2026-05-08 00:43:14,474 - lava_callback - DEBUG - Processing node 69fd3182197af08e45fc55d1: baseline-arm 2026-05-08 00:43:14,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:14,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:14,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3182197af08e45fc55d1/log.txt.gz 2026-05-08 00:43:14,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:14,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:14,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3182197af08e45fc55d1/lava-logs.yaml 2026-05-08 00:43:14,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:14,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:14,963 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3182197af08e45fc55d1/lava_callback.json.gz 2026-05-08 00:43:14,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:14,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3182197af08e45fc55d1 HTTP/1.1" 200 None 2026-05-08 00:43:14,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:15,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:43:15,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:15,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3182197af08e45fc55d1 HTTP/1.1" 200 None 2026-05-08 00:43:15,031 - lava_callback - INFO - Completed processing callback for node 69fd3182197af08e45fc55d1 INFO: 172.20.0.1:40360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40372 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:43:19,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:19,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 00:43:19,830 - lava_callback - INFO - Received callback for node 69fa8e95e18d38d4eb0010e4 INFO: 172.20.0.1:35324 - "POST /node/69fa8e95e18d38d4eb0010e4 HTTP/1.0" 202 Accepted 2026-05-08 00:43:19,836 - lava_callback - INFO - Starting async job submit for node 69fa8e95e18d38d4eb0010e4 2026-05-08 00:43:19,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:19,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e95e18d38d4eb0010e4 HTTP/1.1" 200 None 2026-05-08 00:43:19,851 - lava_callback - DEBUG - Processing node 69fa8e95e18d38d4eb0010e4: baseline-arm-baylibre 2026-05-08 00:43:19,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8e95e18d38d4eb0010e4 2026-05-08 00:43:19,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:19,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8e95e18d38d4eb0010e4 HTTP/1.1" 200 None 2026-05-08 00:43:19,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:19,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:43:19,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:19,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8e95e18d38d4eb0010e4 HTTP/1.1" 200 None 2026-05-08 00:43:19,898 - lava_callback - ERROR - Error processing callback for node 69fa8e95e18d38d4eb0010e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37160 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:43:41,549 - lava_callback - INFO - Received callback for node 69fd317f197af08e45fc55c8 INFO: 172.20.0.1:37662 - "POST /node/69fd317f197af08e45fc55c8 HTTP/1.0" 202 Accepted 2026-05-08 00:43:41,598 - lava_callback - INFO - Starting async job submit for node 69fd317f197af08e45fc55c8 2026-05-08 00:43:41,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:41,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd317f197af08e45fc55c8 HTTP/1.1" 200 None 2026-05-08 00:43:41,634 - lava_callback - DEBUG - Processing node 69fd317f197af08e45fc55c8: baseline-arm 2026-05-08 00:43:41,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:41,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:41,842 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd317f197af08e45fc55c8/log.txt.gz 2026-05-08 00:43:41,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:42,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:42,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd317f197af08e45fc55c8/lava-logs.yaml 2026-05-08 00:43:42,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:42,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:42,238 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd317f197af08e45fc55c8/lava_callback.json.gz 2026-05-08 00:43:42,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:42,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd317f197af08e45fc55c8 HTTP/1.1" 200 None 2026-05-08 00:43:42,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:42,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:43:42,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:42,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd317f197af08e45fc55c8 HTTP/1.1" 200 None 2026-05-08 00:43:42,308 - lava_callback - INFO - Completed processing callback for node 69fd317f197af08e45fc55c8 INFO: 172.20.0.1:37674 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:43:48,777 - lava_callback - INFO - Received callback for node 69fd3181197af08e45fc55ce INFO: 172.20.0.1:37688 - "POST /node/69fd3181197af08e45fc55ce HTTP/1.0" 202 Accepted 2026-05-08 00:43:48,783 - lava_callback - INFO - Starting async job submit for node 69fd3181197af08e45fc55ce 2026-05-08 00:43:48,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:48,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3181197af08e45fc55ce HTTP/1.1" 200 None 2026-05-08 00:43:48,820 - lava_callback - DEBUG - Processing node 69fd3181197af08e45fc55ce: baseline-arm 2026-05-08 00:43:49,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:49,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:49,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 00:43:49,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:49,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3181197af08e45fc55ce/log.txt.gz 2026-05-08 00:43:49,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:49,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:49,484 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3181197af08e45fc55ce/lava-logs.yaml 2026-05-08 00:43:49,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:43:49,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:43:49,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3181197af08e45fc55ce/lava_callback.json.gz 2026-05-08 00:43:49,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:49,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3181197af08e45fc55ce HTTP/1.1" 200 None 2026-05-08 00:43:49,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:49,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:43:49,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:43:49,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3181197af08e45fc55ce HTTP/1.1" 200 None 2026-05-08 00:43:49,682 - lava_callback - INFO - Completed processing callback for node 69fd3181197af08e45fc55ce INFO: 172.20.0.1:40068 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:44:03,504 - lava_callback - INFO - Received callback for node 69fd317e197af08e45fc55c1 INFO: 172.20.0.1:53940 - "POST /node/69fd317e197af08e45fc55c1 HTTP/1.0" 202 Accepted 2026-05-08 00:44:03,510 - lava_callback - INFO - Starting async job submit for node 69fd317e197af08e45fc55c1 2026-05-08 00:44:03,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:03,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd317e197af08e45fc55c1 HTTP/1.1" 200 None 2026-05-08 00:44:03,547 - lava_callback - DEBUG - Processing node 69fd317e197af08e45fc55c1: baseline-arm 2026-05-08 00:44:03,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:03,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:03,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd317e197af08e45fc55c1/log.txt.gz 2026-05-08 00:44:03,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:04,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:04,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd317e197af08e45fc55c1/lava-logs.yaml 2026-05-08 00:44:04,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:04,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:04,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd317e197af08e45fc55c1/lava_callback.json.gz 2026-05-08 00:44:04,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:04,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd317e197af08e45fc55c1 HTTP/1.1" 200 None 2026-05-08 00:44:04,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:04,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:44:04,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:04,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd317e197af08e45fc55c1 HTTP/1.1" 200 None 2026-05-08 00:44:04,255 - lava_callback - INFO - Completed processing callback for node 69fd317e197af08e45fc55c1 INFO: 172.20.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49354 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:44:19,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:19,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 00:44:19,789 - lava_callback - INFO - Received callback for node 69fa8ee1e18d38d4eb00114b INFO: 172.20.0.1:59376 - "POST /node/69fa8ee1e18d38d4eb00114b HTTP/1.0" 202 Accepted 2026-05-08 00:44:19,795 - lava_callback - INFO - Starting async job submit for node 69fa8ee1e18d38d4eb00114b 2026-05-08 00:44:19,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:19,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8ee1e18d38d4eb00114b HTTP/1.1" 200 None 2026-05-08 00:44:19,836 - lava_callback - DEBUG - Processing node 69fa8ee1e18d38d4eb00114b: baseline-arm-baylibre 2026-05-08 00:44:19,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8ee1e18d38d4eb00114b 2026-05-08 00:44:19,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:19,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8ee1e18d38d4eb00114b HTTP/1.1" 200 None 2026-05-08 00:44:19,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:19,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:44:19,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:19,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8ee1e18d38d4eb00114b HTTP/1.1" 200 None 2026-05-08 00:44:19,905 - lava_callback - ERROR - Error processing callback for node 69fa8ee1e18d38d4eb00114b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:44:24,792 - lava_callback - INFO - Received callback for node 69fd31a6197af08e45fc5662 INFO: 172.20.0.1:59380 - "POST /node/69fd31a6197af08e45fc5662 HTTP/1.0" 202 Accepted 2026-05-08 00:44:24,837 - lava_callback - INFO - Starting async job submit for node 69fd31a6197af08e45fc5662 2026-05-08 00:44:24,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:24,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31a6197af08e45fc5662 HTTP/1.1" 200 None 2026-05-08 00:44:24,871 - lava_callback - DEBUG - Processing node 69fd31a6197af08e45fc5662: baseline-arm-pengutronix 2026-05-08 00:44:24,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:25,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:25,252 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a6197af08e45fc5662/log.txt.gz 2026-05-08 00:44:25,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:25,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:25,438 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a6197af08e45fc5662/lava-logs.yaml 2026-05-08 00:44:25,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:25,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:25,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a6197af08e45fc5662/lava_callback.json.gz 2026-05-08 00:44:25,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:25,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31a6197af08e45fc5662 HTTP/1.1" 200 None 2026-05-08 00:44:25,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:25,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:44:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:25,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31a6197af08e45fc5662 HTTP/1.1" 200 None 2026-05-08 00:44:25,625 - lava_callback - INFO - Completed processing callback for node 69fd31a6197af08e45fc5662 INFO: 172.20.0.1:59392 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:44:27,862 - lava_callback - INFO - Received callback for node 69fd3190197af08e45fc55f3 INFO: 172.20.0.1:59394 - "POST /node/69fd3190197af08e45fc55f3 HTTP/1.0" 202 Accepted 2026-05-08 00:44:27,868 - lava_callback - INFO - Starting async job submit for node 69fd3190197af08e45fc55f3 2026-05-08 00:44:27,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:27,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3190197af08e45fc55f3 HTTP/1.1" 200 None 2026-05-08 00:44:27,904 - lava_callback - DEBUG - Processing node 69fd3190197af08e45fc55f3: baseline-arm-broonie 2026-05-08 00:44:28,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:28,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:28,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd3190197af08e45fc55f3/log.txt.gz 2026-05-08 00:44:28,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:28,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:28,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd3190197af08e45fc55f3/lava-logs.yaml 2026-05-08 00:44:28,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:28,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:28,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd3190197af08e45fc55f3/lava_callback.json.gz 2026-05-08 00:44:28,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:28,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3190197af08e45fc55f3 HTTP/1.1" 200 None 2026-05-08 00:44:28,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:28,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:44:28,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:28,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3190197af08e45fc55f3 HTTP/1.1" 200 None 2026-05-08 00:44:28,855 - lava_callback - INFO - Completed processing callback for node 69fd3190197af08e45fc55f3 2026-05-08 00:44:28,958 - lava_callback - INFO - Received callback for node 69fd31a2197af08e45fc5655 INFO: 172.20.0.1:59404 - "POST /node/69fd31a2197af08e45fc5655 HTTP/1.0" 202 Accepted 2026-05-08 00:44:28,968 - lava_callback - INFO - Starting async job submit for node 69fd31a2197af08e45fc5655 2026-05-08 00:44:28,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:29,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31a2197af08e45fc5655 HTTP/1.1" 200 None 2026-05-08 00:44:29,018 - lava_callback - DEBUG - Processing node 69fd31a2197af08e45fc5655: baseline-arm-pengutronix 2026-05-08 00:44:29,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:29,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:29,266 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a2197af08e45fc5655/log.txt.gz 2026-05-08 00:44:29,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:29,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:29,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a2197af08e45fc5655/lava-logs.yaml 2026-05-08 00:44:29,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:29,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:29,602 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a2197af08e45fc5655/lava_callback.json.gz 2026-05-08 00:44:29,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:29,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31a2197af08e45fc5655 HTTP/1.1" 200 None 2026-05-08 00:44:29,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:29,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:44:29,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:29,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31a2197af08e45fc5655 HTTP/1.1" 200 None 2026-05-08 00:44:29,669 - lava_callback - INFO - Completed processing callback for node 69fd31a2197af08e45fc5655 2026-05-08 00:44:31,263 - lava_callback - INFO - Received callback for node 69fd3191197af08e45fc55f6 INFO: 172.20.0.1:39288 - "POST /node/69fd3191197af08e45fc55f6 HTTP/1.0" 202 Accepted 2026-05-08 00:44:31,269 - lava_callback - INFO - Starting async job submit for node 69fd3191197af08e45fc55f6 2026-05-08 00:44:31,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:31,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3191197af08e45fc55f6 HTTP/1.1" 200 None 2026-05-08 00:44:31,305 - lava_callback - DEBUG - Processing node 69fd3191197af08e45fc55f6: baseline-arm-broonie 2026-05-08 00:44:31,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:31,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:31,617 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd3191197af08e45fc55f6/log.txt.gz 2026-05-08 00:44:31,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:31,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:31,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd3191197af08e45fc55f6/lava-logs.yaml 2026-05-08 00:44:31,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:31,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:31,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd3191197af08e45fc55f6/lava_callback.json.gz 2026-05-08 00:44:32,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:32,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3191197af08e45fc55f6 HTTP/1.1" 200 None 2026-05-08 00:44:32,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:32,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:44:32,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:32,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3191197af08e45fc55f6 HTTP/1.1" 200 None 2026-05-08 00:44:32,076 - lava_callback - INFO - Completed processing callback for node 69fd3191197af08e45fc55f6 INFO: 172.20.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55550 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:44:47,518 - lava_callback - INFO - Received callback for node 69fd318e197af08e45fc55f0 INFO: 172.20.0.1:55566 - "POST /node/69fd318e197af08e45fc55f0 HTTP/1.0" 202 Accepted 2026-05-08 00:44:47,523 - lava_callback - INFO - Starting async job submit for node 69fd318e197af08e45fc55f0 2026-05-08 00:44:47,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:47,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd318e197af08e45fc55f0 HTTP/1.1" 200 None 2026-05-08 00:44:47,560 - lava_callback - DEBUG - Processing node 69fd318e197af08e45fc55f0: baseline-arm-broonie 2026-05-08 00:44:47,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:47,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:47,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd318e197af08e45fc55f0/log.txt.gz 2026-05-08 00:44:47,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:48,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:48,120 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd318e197af08e45fc55f0/lava-logs.yaml 2026-05-08 00:44:48,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:48,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:48,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd318e197af08e45fc55f0/lava_callback.json.gz 2026-05-08 00:44:48,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:48,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd318e197af08e45fc55f0 HTTP/1.1" 200 None 2026-05-08 00:44:48,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:48,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:44:48,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:48,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd318e197af08e45fc55f0 HTTP/1.1" 200 None 2026-05-08 00:44:48,324 - lava_callback - INFO - Completed processing callback for node 69fd318e197af08e45fc55f0 2026-05-08 00:44:49,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:49,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 00:44:51,203 - lava_callback - INFO - Received callback for node 69fd319f197af08e45fc564a INFO: 172.20.0.1:54602 - "POST /node/69fd319f197af08e45fc564a HTTP/1.0" 202 Accepted 2026-05-08 00:44:51,209 - lava_callback - INFO - Starting async job submit for node 69fd319f197af08e45fc564a 2026-05-08 00:44:51,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:51,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319f197af08e45fc564a HTTP/1.1" 200 None 2026-05-08 00:44:51,245 - lava_callback - DEBUG - Processing node 69fd319f197af08e45fc564a: baseline-arm-kontron 2026-05-08 00:44:51,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:51,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:51,509 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fd319f197af08e45fc564a/log.txt.gz 2026-05-08 00:44:51,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:51,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:51,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fd319f197af08e45fc564a/lava-logs.yaml 2026-05-08 00:44:51,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:44:51,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:44:51,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fd319f197af08e45fc564a/lava_callback.json.gz 2026-05-08 00:44:51,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:51,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319f197af08e45fc564a HTTP/1.1" 200 None 2026-05-08 00:44:51,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:51,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:44:51,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:51,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd319f197af08e45fc564a HTTP/1.1" 200 None 2026-05-08 00:44:51,930 - lava_callback - INFO - Completed processing callback for node 69fd319f197af08e45fc564a INFO: 172.20.0.1:54618 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:44:59,873 - lava_callback - INFO - Received callback for node 69fa8f07e18d38d4eb00115b INFO: 172.20.0.1:50970 - "POST /node/69fa8f07e18d38d4eb00115b HTTP/1.0" 202 Accepted 2026-05-08 00:44:59,878 - lava_callback - INFO - Starting async job submit for node 69fa8f07e18d38d4eb00115b 2026-05-08 00:44:59,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:59,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8f07e18d38d4eb00115b HTTP/1.1" 200 None 2026-05-08 00:44:59,894 - lava_callback - DEBUG - Processing node 69fa8f07e18d38d4eb00115b: baseline-arm-baylibre 2026-05-08 00:44:59,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8f07e18d38d4eb00115b 2026-05-08 00:44:59,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:59,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8f07e18d38d4eb00115b HTTP/1.1" 200 None 2026-05-08 00:44:59,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:59,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:44:59,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:44:59,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8f07e18d38d4eb00115b HTTP/1.1" 200 None 2026-05-08 00:44:59,949 - lava_callback - ERROR - Error processing callback for node 69fa8f07e18d38d4eb00115b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:45:03,473 - lava_callback - INFO - Received callback for node 69fd3195197af08e45fc5605 INFO: 172.20.0.1:50980 - "POST /node/69fd3195197af08e45fc5605 HTTP/1.0" 202 Accepted 2026-05-08 00:45:03,478 - lava_callback - INFO - Starting async job submit for node 69fd3195197af08e45fc5605 2026-05-08 00:45:03,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:03,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3195197af08e45fc5605 HTTP/1.1" 200 None 2026-05-08 00:45:03,514 - lava_callback - DEBUG - Processing node 69fd3195197af08e45fc5605: baseline-arm-clabbe 2026-05-08 00:45:03,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:03,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:03,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd3195197af08e45fc5605/log.txt.gz 2026-05-08 00:45:03,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:04,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:04,075 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd3195197af08e45fc5605/lava-logs.yaml 2026-05-08 00:45:04,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:04,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:04,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd3195197af08e45fc5605/lava_callback.json.gz 2026-05-08 00:45:04,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:04,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3195197af08e45fc5605 HTTP/1.1" 200 None 2026-05-08 00:45:04,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:04,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:45:04,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:04,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3195197af08e45fc5605 HTTP/1.1" 200 None 2026-05-08 00:45:04,257 - lava_callback - INFO - Completed processing callback for node 69fd3195197af08e45fc5605 INFO: 172.20.0.1:50982 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:45:07,555 - lava_callback - INFO - Received callback for node 69fd318d197af08e45fc55ed INFO: 172.20.0.1:50992 - "POST /node/69fd318d197af08e45fc55ed HTTP/1.0" 202 Accepted 2026-05-08 00:45:07,561 - lava_callback - INFO - Starting async job submit for node 69fd318d197af08e45fc55ed 2026-05-08 00:45:07,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:07,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd318d197af08e45fc55ed HTTP/1.1" 200 None 2026-05-08 00:45:07,597 - lava_callback - DEBUG - Processing node 69fd318d197af08e45fc55ed: baseline-arm-broonie 2026-05-08 00:45:07,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:07,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:07,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd318d197af08e45fc55ed/log.txt.gz 2026-05-08 00:45:08,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:08,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:08,155 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd318d197af08e45fc55ed/lava-logs.yaml 2026-05-08 00:45:08,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:08,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:08,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fd318d197af08e45fc55ed/lava_callback.json.gz 2026-05-08 00:45:08,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:08,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd318d197af08e45fc55ed HTTP/1.1" 200 None 2026-05-08 00:45:08,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:08,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:45:08,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:08,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd318d197af08e45fc55ed HTTP/1.1" 200 None 2026-05-08 00:45:08,352 - lava_callback - INFO - Completed processing callback for node 69fd318d197af08e45fc55ed 2026-05-08 00:45:11,220 - lava_callback - INFO - Received callback for node 69fd319d197af08e45fc5647 INFO: 172.20.0.1:52608 - "POST /node/69fd319d197af08e45fc5647 HTTP/1.0" 202 Accepted 2026-05-08 00:45:11,226 - lava_callback - INFO - Starting async job submit for node 69fd319d197af08e45fc5647 2026-05-08 00:45:11,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:11,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319d197af08e45fc5647 HTTP/1.1" 200 None 2026-05-08 00:45:11,262 - lava_callback - DEBUG - Processing node 69fd319d197af08e45fc5647: baseline-arm-kontron 2026-05-08 00:45:11,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:11,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:11,516 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fd319d197af08e45fc5647/log.txt.gz 2026-05-08 00:45:11,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:11,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:11,754 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fd319d197af08e45fc5647/lava-logs.yaml 2026-05-08 00:45:11,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:11,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:11,864 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fd319d197af08e45fc5647/lava_callback.json.gz 2026-05-08 00:45:11,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:11,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319d197af08e45fc5647 HTTP/1.1" 200 None 2026-05-08 00:45:11,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:11,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:45:11,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:11,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd319d197af08e45fc5647 HTTP/1.1" 200 None 2026-05-08 00:45:11,948 - lava_callback - INFO - Completed processing callback for node 69fd319d197af08e45fc5647 INFO: 172.20.0.1:52614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52616 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:45:19,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:19,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:57392 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:45:28,415 - lava_callback - INFO - Received callback for node 69fd31a3197af08e45fc565c INFO: 172.20.0.1:57396 - "POST /node/69fd31a3197af08e45fc565c HTTP/1.0" 202 Accepted 2026-05-08 00:45:28,421 - lava_callback - INFO - Starting async job submit for node 69fd31a3197af08e45fc565c 2026-05-08 00:45:28,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:28,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31a3197af08e45fc565c HTTP/1.1" 200 None 2026-05-08 00:45:28,482 - lava_callback - DEBUG - Processing node 69fd31a3197af08e45fc565c: baseline-arm-pengutronix 2026-05-08 00:45:28,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:28,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:28,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a3197af08e45fc565c/log.txt.gz 2026-05-08 00:45:28,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:28,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:28,975 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a3197af08e45fc565c/lava-logs.yaml 2026-05-08 00:45:28,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:29,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:29,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a3197af08e45fc565c/lava_callback.json.gz 2026-05-08 00:45:29,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:29,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31a3197af08e45fc565c HTTP/1.1" 200 None 2026-05-08 00:45:29,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:29,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:45:29,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:29,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31a3197af08e45fc565c HTTP/1.1" 200 None 2026-05-08 00:45:29,267 - lava_callback - INFO - Completed processing callback for node 69fd31a3197af08e45fc565c 2026-05-08 00:45:29,276 - lava_callback - INFO - Received callback for node 69fd31bd197af08e45fc5695 INFO: 172.20.0.1:57404 - "POST /node/69fd31bd197af08e45fc5695 HTTP/1.0" 202 Accepted 2026-05-08 00:45:29,290 - lava_callback - INFO - Starting async job submit for node 69fd31bd197af08e45fc5695 2026-05-08 00:45:29,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:29,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31bd197af08e45fc5695 HTTP/1.1" 200 None 2026-05-08 00:45:29,351 - lava_callback - DEBUG - Processing node 69fd31bd197af08e45fc5695: ltp-dio 2026-05-08 00:45:29,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:29,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:29,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69fd31bd197af08e45fc5695/log.txt.gz 2026-05-08 00:45:30,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:30,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:30,419 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69fd31bd197af08e45fc5695/lava-logs.yaml 2026-05-08 00:45:30,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:30,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:30,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69fd31bd197af08e45fc5695/lava_callback.json.gz 2026-05-08 00:45:30,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:30,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31bd197af08e45fc5695 HTTP/1.1" 200 None 2026-05-08 00:45:30,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:30,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:45:30,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:30,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31bd197af08e45fc5695 HTTP/1.1" 200 None 2026-05-08 00:45:30,641 - lava_callback - INFO - Completed processing callback for node 69fd31bd197af08e45fc5695 INFO: 172.20.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54170 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:45:39,879 - lava_callback - INFO - Received callback for node 69fa8f2de18d38d4eb00116d INFO: 172.20.0.1:42156 - "POST /node/69fa8f2de18d38d4eb00116d HTTP/1.0" 202 Accepted 2026-05-08 00:45:39,885 - lava_callback - INFO - Starting async job submit for node 69fa8f2de18d38d4eb00116d 2026-05-08 00:45:39,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:39,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8f2de18d38d4eb00116d HTTP/1.1" 200 None 2026-05-08 00:45:39,905 - lava_callback - DEBUG - Processing node 69fa8f2de18d38d4eb00116d: baseline-arm-baylibre 2026-05-08 00:45:39,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8f2de18d38d4eb00116d 2026-05-08 00:45:39,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:39,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8f2de18d38d4eb00116d HTTP/1.1" 200 None 2026-05-08 00:45:39,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:39,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:45:39,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:39,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8f2de18d38d4eb00116d HTTP/1.1" 200 None 2026-05-08 00:45:39,951 - lava_callback - ERROR - Error processing callback for node 69fa8f2de18d38d4eb00116d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42166 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:45:49,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:49,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 00:45:52,348 - lava_callback - INFO - Received callback for node 69fd3196197af08e45fc5609 INFO: 172.20.0.1:32896 - "POST /node/69fd3196197af08e45fc5609 HTTP/1.0" 202 Accepted 2026-05-08 00:45:52,355 - lava_callback - INFO - Starting async job submit for node 69fd3196197af08e45fc5609 2026-05-08 00:45:52,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:52,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3196197af08e45fc5609 HTTP/1.1" 200 None 2026-05-08 00:45:52,389 - lava_callback - DEBUG - Processing node 69fd3196197af08e45fc5609: baseline-arm-clabbe 2026-05-08 00:45:52,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:52,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:52,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd3196197af08e45fc5609/log.txt.gz 2026-05-08 00:45:52,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:52,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:52,960 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd3196197af08e45fc5609/lava-logs.yaml 2026-05-08 00:45:52,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:45:53,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:45:53,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd3196197af08e45fc5609/lava_callback.json.gz 2026-05-08 00:45:53,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:53,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3196197af08e45fc5609 HTTP/1.1" 200 None 2026-05-08 00:45:53,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:53,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:45:53,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:45:53,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3196197af08e45fc5609 HTTP/1.1" 200 None 2026-05-08 00:45:53,151 - lava_callback - INFO - Completed processing callback for node 69fd3196197af08e45fc5609 INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37392 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:46:19,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:46:19,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 00:46:19,941 - lava_callback - INFO - Received callback for node 69fa8f55e18d38d4eb001178 INFO: 172.20.0.1:47500 - "POST /node/69fa8f55e18d38d4eb001178 HTTP/1.0" 202 Accepted 2026-05-08 00:46:19,947 - lava_callback - INFO - Starting async job submit for node 69fa8f55e18d38d4eb001178 2026-05-08 00:46:19,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:46:19,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8f55e18d38d4eb001178 HTTP/1.1" 200 None 2026-05-08 00:46:19,962 - lava_callback - DEBUG - Processing node 69fa8f55e18d38d4eb001178: baseline-arm-baylibre 2026-05-08 00:46:19,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8f55e18d38d4eb001178 2026-05-08 00:46:19,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:46:19,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8f55e18d38d4eb001178 HTTP/1.1" 200 None 2026-05-08 00:46:19,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:46:19,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:46:19,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:46:20,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8f55e18d38d4eb001178 HTTP/1.1" 200 None 2026-05-08 00:46:20,014 - lava_callback - ERROR - Error processing callback for node 69fa8f55e18d38d4eb001178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51134 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:46:59,966 - lava_callback - INFO - Received callback for node 69fa8f7ce18d38d4eb001191 INFO: 172.20.0.1:58972 - "POST /node/69fa8f7ce18d38d4eb001191 HTTP/1.0" 202 Accepted 2026-05-08 00:46:59,972 - lava_callback - INFO - Starting async job submit for node 69fa8f7ce18d38d4eb001191 2026-05-08 00:46:59,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:46:59,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8f7ce18d38d4eb001191 HTTP/1.1" 200 None 2026-05-08 00:46:59,988 - lava_callback - DEBUG - Processing node 69fa8f7ce18d38d4eb001191: baseline-arm-baylibre 2026-05-08 00:46:59,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8f7ce18d38d4eb001191 2026-05-08 00:46:59,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:00,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8f7ce18d38d4eb001191 HTTP/1.1" 200 None 2026-05-08 00:47:00,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:00,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:47:00,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:00,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8f7ce18d38d4eb001191 HTTP/1.1" 200 None 2026-05-08 00:47:00,048 - lava_callback - ERROR - Error processing callback for node 69fa8f7ce18d38d4eb001191: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:47:03,316 - lava_callback - INFO - Received callback for node 69fd319a197af08e45fc563e INFO: 172.20.0.1:58976 - "POST /node/69fd319a197af08e45fc563e HTTP/1.0" 202 Accepted 2026-05-08 00:47:03,322 - lava_callback - INFO - Starting async job submit for node 69fd319a197af08e45fc563e 2026-05-08 00:47:03,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:03,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319a197af08e45fc563e HTTP/1.1" 200 None 2026-05-08 00:47:03,358 - lava_callback - DEBUG - Processing node 69fd319a197af08e45fc563e: baseline-arm-clabbe 2026-05-08 00:47:03,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:03,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:03,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd319a197af08e45fc563e/log.txt.gz 2026-05-08 00:47:03,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:03,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:03,955 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd319a197af08e45fc563e/lava-logs.yaml 2026-05-08 00:47:03,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:04,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:04,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fd319a197af08e45fc563e/lava_callback.json.gz 2026-05-08 00:47:04,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:04,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319a197af08e45fc563e HTTP/1.1" 200 None 2026-05-08 00:47:04,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:04,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:47:04,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:04,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd319a197af08e45fc563e HTTP/1.1" 200 None 2026-05-08 00:47:04,139 - lava_callback - INFO - Completed processing callback for node 69fd319a197af08e45fc563e INFO: 172.20.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:47:19,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:19,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51982 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:47:51,877 - lava_callback - INFO - Received callback for node 69fd31b8197af08e45fc568b INFO: 172.20.0.1:53286 - "POST /node/69fd31b8197af08e45fc568b HTTP/1.0" 202 Accepted 2026-05-08 00:47:51,884 - lava_callback - INFO - Starting async job submit for node 69fd31b8197af08e45fc568b 2026-05-08 00:47:51,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:51,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31b8197af08e45fc568b HTTP/1.1" 200 None 2026-05-08 00:47:51,923 - lava_callback - DEBUG - Processing node 69fd31b8197af08e45fc568b: ltp-containers 2026-05-08 00:47:52,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:52,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:52,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69fd31b8197af08e45fc568b/log.txt.gz 2026-05-08 00:47:52,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:52,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:52,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69fd31b8197af08e45fc568b/lava-logs.yaml 2026-05-08 00:47:52,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:52,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:52,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69fd31b8197af08e45fc568b/lava_callback.json.gz 2026-05-08 00:47:52,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:52,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31b8197af08e45fc568b HTTP/1.1" 200 None 2026-05-08 00:47:52,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:52,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:47:52,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:52,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31b8197af08e45fc568b HTTP/1.1" 200 None 2026-05-08 00:47:52,935 - lava_callback - INFO - Completed processing callback for node 69fd31b8197af08e45fc568b 2026-05-08 00:47:53,628 - lava_callback - INFO - Received callback for node 69fd31bb197af08e45fc5692 INFO: 172.20.0.1:53296 - "POST /node/69fd31bb197af08e45fc5692 HTTP/1.0" 202 Accepted 2026-05-08 00:47:53,634 - lava_callback - INFO - Starting async job submit for node 69fd31bb197af08e45fc5692 2026-05-08 00:47:53,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:53,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31bb197af08e45fc5692 HTTP/1.1" 200 None 2026-05-08 00:47:53,677 - lava_callback - DEBUG - Processing node 69fd31bb197af08e45fc5692: ltp-cve 2026-05-08 00:47:54,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:54,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:54,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69fd31bb197af08e45fc5692/log.txt.gz 2026-05-08 00:47:54,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:54,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:54,516 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69fd31bb197af08e45fc5692/lava-logs.yaml 2026-05-08 00:47:54,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:54,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:54,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69fd31bb197af08e45fc5692/lava_callback.json.gz 2026-05-08 00:47:54,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:54,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31bb197af08e45fc5692 HTTP/1.1" 200 None 2026-05-08 00:47:54,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:54,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:47:54,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:54,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31bb197af08e45fc5692 HTTP/1.1" 200 None 2026-05-08 00:47:54,724 - lava_callback - INFO - Completed processing callback for node 69fd31bb197af08e45fc5692 2026-05-08 00:47:55,172 - lava_callback - INFO - Received callback for node 69fd31c9197af08e45fc56bb INFO: 172.20.0.1:53312 - "POST /node/69fd31c9197af08e45fc56bb HTTP/1.0" 202 Accepted 2026-05-08 00:47:55,180 - lava_callback - INFO - Starting async job submit for node 69fd31c9197af08e45fc56bb 2026-05-08 00:47:55,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:55,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c9197af08e45fc56bb HTTP/1.1" 200 None 2026-05-08 00:47:55,222 - lava_callback - DEBUG - Processing node 69fd31c9197af08e45fc56bb: ltp-syscalls 2026-05-08 00:47:55,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:56,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:56,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fd31c9197af08e45fc56bb/log.txt.gz 2026-05-08 00:47:56,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53314 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:47:56,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:56,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fd31c9197af08e45fc56bb/lava-logs.yaml 2026-05-08 00:47:56,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:47:56,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:47:56,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fd31c9197af08e45fc56bb/lava_callback.json.gz 2026-05-08 00:47:56,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:56,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c9197af08e45fc56bb HTTP/1.1" 200 None 2026-05-08 00:47:56,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:56,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:47:56,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:47:56,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31c9197af08e45fc56bb HTTP/1.1" 200 None 2026-05-08 00:47:56,861 - lava_callback - INFO - Completed processing callback for node 69fd31c9197af08e45fc56bb INFO: 172.20.0.1:39886 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:48:11,928 - lava_callback - INFO - Received callback for node 69fd31b9197af08e45fc568e INFO: 172.20.0.1:49836 - "POST /node/69fd31b9197af08e45fc568e HTTP/1.0" 202 Accepted 2026-05-08 00:48:11,935 - lava_callback - INFO - Starting async job submit for node 69fd31b9197af08e45fc568e 2026-05-08 00:48:11,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:11,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31b9197af08e45fc568e HTTP/1.1" 200 None 2026-05-08 00:48:11,973 - lava_callback - DEBUG - Processing node 69fd31b9197af08e45fc568e: ltp-controllers 2026-05-08 00:48:12,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:48:12,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:48:12,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69fd31b9197af08e45fc568e/log.txt.gz 2026-05-08 00:48:12,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:48:13,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:48:13,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69fd31b9197af08e45fc568e/lava-logs.yaml 2026-05-08 00:48:13,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:48:13,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:48:13,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69fd31b9197af08e45fc568e/lava_callback.json.gz 2026-05-08 00:48:13,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:13,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31b9197af08e45fc568e HTTP/1.1" 200 None 2026-05-08 00:48:13,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:13,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:48:13,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:13,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31b9197af08e45fc568e HTTP/1.1" 200 None 2026-05-08 00:48:13,568 - lava_callback - INFO - Completed processing callback for node 69fd31b9197af08e45fc568e INFO: 172.20.0.1:49846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49852 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:48:19,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:19,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:48:56,977 - lava_callback - INFO - Received callback for node 69fa8fede18d38d4eb0011ce INFO: 172.20.0.1:34608 - "POST /node/69fa8fede18d38d4eb0011ce HTTP/1.0" 202 Accepted 2026-05-08 00:48:56,982 - lava_callback - INFO - Starting async job submit for node 69fa8fede18d38d4eb0011ce 2026-05-08 00:48:56,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:56,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8fede18d38d4eb0011ce HTTP/1.1" 200 None 2026-05-08 00:48:56,998 - lava_callback - DEBUG - Processing node 69fa8fede18d38d4eb0011ce: baseline-arm-clabbe 2026-05-08 00:48:56,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa8fede18d38d4eb0011ce 2026-05-08 00:48:56,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:57,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8fede18d38d4eb0011ce HTTP/1.1" 200 None 2026-05-08 00:48:57,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:57,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:48:57,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:48:57,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa8fede18d38d4eb0011ce HTTP/1.1" 200 None 2026-05-08 00:48:57,052 - lava_callback - ERROR - Error processing callback for node 69fa8fede18d38d4eb0011ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44424 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:49:27,975 - lava_callback - INFO - Received callback for node 69fd31bf197af08e45fc569c INFO: 172.20.0.1:44436 - "POST /node/69fd31bf197af08e45fc569c HTTP/1.0" 202 Accepted 2026-05-08 00:49:27,983 - lava_callback - INFO - Starting async job submit for node 69fd31bf197af08e45fc569c 2026-05-08 00:49:28,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:28,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31bf197af08e45fc569c HTTP/1.1" 200 None 2026-05-08 00:49:28,036 - lava_callback - DEBUG - Processing node 69fd31bf197af08e45fc569c: ltp-fs_bind 2026-05-08 00:49:28,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:49:28,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:49:28,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fd31bf197af08e45fc569c/log.txt.gz 2026-05-08 00:49:29,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:49:29,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:49:29,248 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fd31bf197af08e45fc569c/lava-logs.yaml 2026-05-08 00:49:29,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:49:29,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:49:29,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fd31bf197af08e45fc569c/lava_callback.json.gz 2026-05-08 00:49:29,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:29,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31bf197af08e45fc569c HTTP/1.1" 200 None 2026-05-08 00:49:29,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:29,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:49:29,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:29,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31bf197af08e45fc569c HTTP/1.1" 200 None 2026-05-08 00:49:29,515 - lava_callback - INFO - Completed processing callback for node 69fd31bf197af08e45fc569c 2026-05-08 00:49:31,600 - lava_callback - INFO - Received callback for node 69fd31b6197af08e45fc5687 INFO: 172.20.0.1:58298 - "POST /node/69fd31b6197af08e45fc5687 HTTP/1.0" 202 Accepted 2026-05-08 00:49:31,608 - lava_callback - INFO - Starting async job submit for node 69fd31b6197af08e45fc5687 2026-05-08 00:49:31,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:31,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31b6197af08e45fc5687 HTTP/1.1" 200 None 2026-05-08 00:49:31,681 - lava_callback - DEBUG - Processing node 69fd31b6197af08e45fc5687: ltp-cap_bounds 2026-05-08 00:49:32,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:49:32,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:49:32,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fd31b6197af08e45fc5687/log.txt.gz 2026-05-08 00:49:32,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:49:32,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:49:32,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fd31b6197af08e45fc5687/lava-logs.yaml 2026-05-08 00:49:32,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:49:32,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:49:32,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fd31b6197af08e45fc5687/lava_callback.json.gz 2026-05-08 00:49:32,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:32,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31b6197af08e45fc5687 HTTP/1.1" 200 None 2026-05-08 00:49:32,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:32,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:49:32,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:33,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31b6197af08e45fc5687 HTTP/1.1" 200 None 2026-05-08 00:49:33,029 - lava_callback - INFO - Completed processing callback for node 69fd31b6197af08e45fc5687 INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58302 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:49:37,030 - lava_callback - INFO - Received callback for node 69fa9014e18d38d4eb0011e0 INFO: 172.20.0.1:58316 - "POST /node/69fa9014e18d38d4eb0011e0 HTTP/1.0" 202 Accepted 2026-05-08 00:49:37,036 - lava_callback - INFO - Starting async job submit for node 69fa9014e18d38d4eb0011e0 2026-05-08 00:49:37,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:37,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9014e18d38d4eb0011e0 HTTP/1.1" 200 None 2026-05-08 00:49:37,057 - lava_callback - DEBUG - Processing node 69fa9014e18d38d4eb0011e0: baseline-arm-clabbe 2026-05-08 00:49:37,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9014e18d38d4eb0011e0 2026-05-08 00:49:37,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:37,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9014e18d38d4eb0011e0 HTTP/1.1" 200 None 2026-05-08 00:49:37,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:37,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:49:37,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:37,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9014e18d38d4eb0011e0 HTTP/1.1" 200 None 2026-05-08 00:49:37,112 - lava_callback - ERROR - Error processing callback for node 69fa9014e18d38d4eb0011e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:49:49,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:49:49,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44866 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:50:17,097 - lava_callback - INFO - Received callback for node 69fa903be18d38d4eb0011f2 INFO: 172.20.0.1:44882 - "POST /node/69fa903be18d38d4eb0011f2 HTTP/1.0" 202 Accepted 2026-05-08 00:50:17,105 - lava_callback - INFO - Starting async job submit for node 69fa903be18d38d4eb0011f2 2026-05-08 00:50:17,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:50:17,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa903be18d38d4eb0011f2 HTTP/1.1" 200 None 2026-05-08 00:50:17,126 - lava_callback - DEBUG - Processing node 69fa903be18d38d4eb0011f2: baseline-arm-clabbe 2026-05-08 00:50:17,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa903be18d38d4eb0011f2 2026-05-08 00:50:17,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:50:17,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa903be18d38d4eb0011f2 HTTP/1.1" 200 None 2026-05-08 00:50:17,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:50:17,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:50:17,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:50:17,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa903be18d38d4eb0011f2 HTTP/1.1" 200 None 2026-05-08 00:50:17,198 - lava_callback - ERROR - Error processing callback for node 69fa903be18d38d4eb0011f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34626 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:50:57,018 - lava_callback - INFO - Received callback for node 69fa9062e18d38d4eb001205 INFO: 172.20.0.1:34642 - "POST /node/69fa9062e18d38d4eb001205 HTTP/1.0" 202 Accepted 2026-05-08 00:50:57,024 - lava_callback - INFO - Starting async job submit for node 69fa9062e18d38d4eb001205 2026-05-08 00:50:57,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:50:57,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9062e18d38d4eb001205 HTTP/1.1" 200 None 2026-05-08 00:50:57,039 - lava_callback - DEBUG - Processing node 69fa9062e18d38d4eb001205: baseline-arm-clabbe 2026-05-08 00:50:57,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9062e18d38d4eb001205 2026-05-08 00:50:57,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:50:57,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9062e18d38d4eb001205 HTTP/1.1" 200 None 2026-05-08 00:50:57,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:50:57,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 00:50:57,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:50:57,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9062e18d38d4eb001205 HTTP/1.1" 200 None 2026-05-08 00:50:57,085 - lava_callback - ERROR - Error processing callback for node 69fa9062e18d38d4eb001205: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:51:51,608 - lava_callback - INFO - Received callback for node 69fd31c0197af08e45fc569f INFO: 172.20.0.1:49016 - "POST /node/69fd31c0197af08e45fc569f HTTP/1.0" 202 Accepted 2026-05-08 00:51:51,614 - lava_callback - INFO - Starting async job submit for node 69fd31c0197af08e45fc569f 2026-05-08 00:51:51,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:51:51,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c0197af08e45fc569f HTTP/1.1" 200 None 2026-05-08 00:51:51,652 - lava_callback - DEBUG - Processing node 69fd31c0197af08e45fc569f: ltp-fsx 2026-05-08 00:51:52,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:51:52,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:51:52,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69fd31c0197af08e45fc569f/log.txt.gz 2026-05-08 00:51:52,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:51:52,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:51:52,665 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69fd31c0197af08e45fc569f/lava-logs.yaml 2026-05-08 00:51:52,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:51:52,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:51:52,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69fd31c0197af08e45fc569f/lava_callback.json.gz 2026-05-08 00:51:52,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:51:52,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c0197af08e45fc569f HTTP/1.1" 200 None 2026-05-08 00:51:52,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:51:52,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:51:52,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:51:52,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31c0197af08e45fc569f HTTP/1.1" 200 None 2026-05-08 00:51:52,910 - lava_callback - INFO - Completed processing callback for node 69fd31c0197af08e45fc569f 2026-05-08 00:51:53,310 - lava_callback - INFO - Received callback for node 69fd31c2197af08e45fc56a4 INFO: 172.20.0.1:49018 - "POST /node/69fd31c2197af08e45fc56a4 HTTP/1.0" 202 Accepted 2026-05-08 00:51:53,316 - lava_callback - INFO - Starting async job submit for node 69fd31c2197af08e45fc56a4 2026-05-08 00:51:53,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:51:53,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c2197af08e45fc56a4 HTTP/1.1" 200 None 2026-05-08 00:51:53,358 - lava_callback - DEBUG - Processing node 69fd31c2197af08e45fc56a4: ltp-input 2026-05-08 00:51:53,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:51:53,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:51:53,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69fd31c2197af08e45fc56a4/log.txt.gz 2026-05-08 00:51:54,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:51:54,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:51:54,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69fd31c2197af08e45fc56a4/lava-logs.yaml 2026-05-08 00:51:54,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:51:54,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:51:54,324 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69fd31c2197af08e45fc56a4/lava_callback.json.gz 2026-05-08 00:51:54,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:51:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c2197af08e45fc56a4 HTTP/1.1" 200 None 2026-05-08 00:51:54,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:51:54,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:51:54,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:51:54,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31c2197af08e45fc56a4 HTTP/1.1" 200 None 2026-05-08 00:51:54,400 - lava_callback - INFO - Completed processing callback for node 69fd31c2197af08e45fc56a4 INFO: 172.20.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35806 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:52:14,360 - lava_callback - INFO - Received callback for node 69fd33a0197af08e45fc5819 INFO: 172.20.0.1:50056 - "POST /node/69fd33a0197af08e45fc5819 HTTP/1.0" 202 Accepted 2026-05-08 00:52:14,371 - lava_callback - INFO - Starting async job submit for node 69fd33a0197af08e45fc5819 2026-05-08 00:52:14,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:14,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd33a0197af08e45fc5819 HTTP/1.1" 200 None 2026-05-08 00:52:14,409 - lava_callback - DEBUG - Processing node 69fd33a0197af08e45fc5819: baseline-arm 2026-05-08 00:52:14,419 - lava_callback - WARNING - Failed to upload log 2026-05-08 00:52:14,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:52:14,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:52:14,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd33a0197af08e45fc5819/lava-logs.yaml 2026-05-08 00:52:14,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:52:14,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:52:14,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd33a0197af08e45fc5819/lava_callback.json.gz 2026-05-08 00:52:14,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:14,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd33a0197af08e45fc5819 HTTP/1.1" 200 None 2026-05-08 00:52:14,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:14,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:52:14,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:14,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd33a0197af08e45fc5819 HTTP/1.1" 200 None 2026-05-08 00:52:14,800 - lava_callback - INFO - Completed processing callback for node 69fd33a0197af08e45fc5819 INFO: 172.20.0.1:50072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50084 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:52:19,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:19,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:52:51,715 - lava_callback - INFO - Received callback for node 69fd31c3197af08e45fc56a8 INFO: 172.20.0.1:42398 - "POST /node/69fd31c3197af08e45fc56a8 HTTP/1.0" 202 Accepted 2026-05-08 00:52:51,722 - lava_callback - INFO - Starting async job submit for node 69fd31c3197af08e45fc56a8 2026-05-08 00:52:51,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:51,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c3197af08e45fc56a8 HTTP/1.1" 200 None 2026-05-08 00:52:51,767 - lava_callback - DEBUG - Processing node 69fd31c3197af08e45fc56a8: ltp-ipc 2026-05-08 00:52:52,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:52:52,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:52:52,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69fd31c3197af08e45fc56a8/log.txt.gz 2026-05-08 00:52:52,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:52:52,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:52:52,836 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69fd31c3197af08e45fc56a8/lava-logs.yaml 2026-05-08 00:52:52,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:52:52,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:52:52,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69fd31c3197af08e45fc56a8/lava_callback.json.gz 2026-05-08 00:52:52,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:53,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c3197af08e45fc56a8 HTTP/1.1" 200 None 2026-05-08 00:52:53,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:53,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:52:53,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:52:53,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31c3197af08e45fc56a8 HTTP/1.1" 200 None 2026-05-08 00:52:53,064 - lava_callback - INFO - Completed processing callback for node 69fd31c3197af08e45fc56a8 INFO: 172.20.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:53:19,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:53:19,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56038 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:53:48,260 - lava_callback - INFO - Received callback for node 69fd31c6197af08e45fc56b5 INFO: 172.20.0.1:56046 - "POST /node/69fd31c6197af08e45fc56b5 HTTP/1.0" 202 Accepted 2026-05-08 00:53:48,270 - lava_callback - INFO - Starting async job submit for node 69fd31c6197af08e45fc56b5 2026-05-08 00:53:48,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:53:48,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c6197af08e45fc56b5 HTTP/1.1" 200 None 2026-05-08 00:53:48,331 - lava_callback - DEBUG - Processing node 69fd31c6197af08e45fc56b5: ltp-sched 2026-05-08 00:53:48,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:53:48,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:53:48,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69fd31c6197af08e45fc56b5/log.txt.gz 2026-05-08 00:53:49,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:53:49,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:53:49,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69fd31c6197af08e45fc56b5/lava-logs.yaml 2026-05-08 00:53:49,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:53:49,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:53:49,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69fd31c6197af08e45fc56b5/lava_callback.json.gz 2026-05-08 00:53:49,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:53:49,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c6197af08e45fc56b5 HTTP/1.1" 200 None 2026-05-08 00:53:49,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:53:49,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:53:49,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:53:49,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31c6197af08e45fc56b5 HTTP/1.1" 200 None 2026-05-08 00:53:49,691 - lava_callback - INFO - Completed processing callback for node 69fd31c6197af08e45fc56b5 INFO: 172.20.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:54:19,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:54:19,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34282 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:55:51,871 - lava_callback - INFO - Received callback for node 69fd31c7197af08e45fc56b8 INFO: 172.20.0.1:60216 - "POST /node/69fd31c7197af08e45fc56b8 HTTP/1.0" 202 Accepted 2026-05-08 00:55:51,881 - lava_callback - INFO - Starting async job submit for node 69fd31c7197af08e45fc56b8 2026-05-08 00:55:51,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:55:51,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c7197af08e45fc56b8 HTTP/1.1" 200 None 2026-05-08 00:55:51,957 - lava_callback - DEBUG - Processing node 69fd31c7197af08e45fc56b8: ltp-smoke 2026-05-08 00:55:52,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:55:52,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:55:52,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd31c7197af08e45fc56b8/log.txt.gz 2026-05-08 00:55:52,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:55:53,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:55:53,210 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd31c7197af08e45fc56b8/lava-logs.yaml 2026-05-08 00:55:53,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:55:53,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:55:53,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd31c7197af08e45fc56b8/lava_callback.json.gz 2026-05-08 00:55:53,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:55:53,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c7197af08e45fc56b8 HTTP/1.1" 200 None 2026-05-08 00:55:53,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:55:53,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:55:53,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:55:53,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31c7197af08e45fc56b8 HTTP/1.1" 200 None 2026-05-08 00:55:53,532 - lava_callback - INFO - Completed processing callback for node 69fd31c7197af08e45fc56b8 2026-05-08 00:55:53,550 - lava_callback - INFO - Received callback for node 69fd31ca197af08e45fc56be INFO: 172.20.0.1:60228 - "POST /node/69fd31ca197af08e45fc56be HTTP/1.0" 202 Accepted 2026-05-08 00:55:53,565 - lava_callback - INFO - Starting async job submit for node 69fd31ca197af08e45fc56be 2026-05-08 00:55:53,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:55:53,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31ca197af08e45fc56be HTTP/1.1" 200 None 2026-05-08 00:55:53,672 - lava_callback - DEBUG - Processing node 69fd31ca197af08e45fc56be: ltp-syscalls-ipc 2026-05-08 00:55:54,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:55:54,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:55:54,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fd31ca197af08e45fc56be/log.txt.gz 2026-05-08 00:55:54,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:55:54,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:55:54,939 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fd31ca197af08e45fc56be/lava-logs.yaml 2026-05-08 00:55:54,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:55:55,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:55:55,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fd31ca197af08e45fc56be/lava_callback.json.gz 2026-05-08 00:55:55,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:55:55,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31ca197af08e45fc56be HTTP/1.1" 200 None 2026-05-08 00:55:55,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:55:55,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:55:55,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:55:55,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31ca197af08e45fc56be HTTP/1.1" 200 None 2026-05-08 00:55:55,217 - lava_callback - INFO - Completed processing callback for node 69fd31ca197af08e45fc56be INFO: 172.20.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39484 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:56:19,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:56:19,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60838 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:56:48,630 - lava_callback - INFO - Received callback for node 69fd3012197af08e45fc5515 INFO: 172.20.0.1:60850 - "POST /node/69fd3012197af08e45fc5515 HTTP/1.0" 202 Accepted 2026-05-08 00:56:48,639 - lava_callback - INFO - Starting async job submit for node 69fd3012197af08e45fc5515 2026-05-08 00:56:48,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:56:48,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3012197af08e45fc5515 HTTP/1.1" 200 None 2026-05-08 00:56:48,747 - lava_callback - DEBUG - Processing node 69fd3012197af08e45fc5515: ltp-smoke 2026-05-08 00:56:49,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:56:49,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:56:49,685 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd3012197af08e45fc5515/log.txt.gz 2026-05-08 00:56:50,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:56:53,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:56:53,570 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd3012197af08e45fc5515/lava-logs.yaml 2026-05-08 00:56:53,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:56:53,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:56:53,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd3012197af08e45fc5515/lava_callback.json.gz 2026-05-08 00:56:53,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:56:53,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3012197af08e45fc5515 HTTP/1.1" 200 None 2026-05-08 00:56:53,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:56:53,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf7197af08e45fc2dd5 HTTP/1.1" 200 None 2026-05-08 00:56:53,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:56:53,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3012197af08e45fc5515 HTTP/1.1" 200 None 2026-05-08 00:56:54,074 - lava_callback - INFO - Completed processing callback for node 69fd3012197af08e45fc5515 INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43314 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:57:19,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:57:19,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59656 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:57:32,019 - lava_callback - INFO - Received callback for node 69fd31cc197af08e45fc56c1 INFO: 172.20.0.1:40000 - "POST /node/69fd31cc197af08e45fc56c1 HTTP/1.0" 202 Accepted 2026-05-08 00:57:32,025 - lava_callback - INFO - Starting async job submit for node 69fd31cc197af08e45fc56c1 2026-05-08 00:57:32,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:57:32,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31cc197af08e45fc56c1 HTTP/1.1" 200 None 2026-05-08 00:57:32,065 - lava_callback - DEBUG - Processing node 69fd31cc197af08e45fc56c1: ltp-timers 2026-05-08 00:57:32,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:57:32,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:57:32,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69fd31cc197af08e45fc56c1/log.txt.gz 2026-05-08 00:57:32,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:57:32,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:57:32,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69fd31cc197af08e45fc56c1/lava-logs.yaml 2026-05-08 00:57:32,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:57:33,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:57:33,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69fd31cc197af08e45fc56c1/lava_callback.json.gz 2026-05-08 00:57:33,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:57:33,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31cc197af08e45fc56c1 HTTP/1.1" 200 None 2026-05-08 00:57:33,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:57:33,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:57:33,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:57:33,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31cc197af08e45fc56c1 HTTP/1.1" 200 None 2026-05-08 00:57:33,148 - lava_callback - INFO - Completed processing callback for node 69fd31cc197af08e45fc56c1 INFO: 172.20.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53210 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:57:49,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:57:49,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44816 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:58:02,096 - lava_callback - INFO - Received callback for node 69fd34d0197af08e45fc58ad INFO: 172.20.0.1:34958 - "POST /node/69fd34d0197af08e45fc58ad HTTP/1.0" 202 Accepted 2026-05-08 00:58:02,102 - lava_callback - INFO - Starting async job submit for node 69fd34d0197af08e45fc58ad 2026-05-08 00:58:02,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:02,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd34d0197af08e45fc58ad HTTP/1.1" 200 None 2026-05-08 00:58:02,144 - lava_callback - DEBUG - Processing node 69fd34d0197af08e45fc58ad: baseline-arm-pengutronix 2026-05-08 00:58:02,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:58:02,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:58:02,383 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd34d0197af08e45fc58ad/log.txt.gz 2026-05-08 00:58:02,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:58:02,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:58:02,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd34d0197af08e45fc58ad/lava-logs.yaml 2026-05-08 00:58:02,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:58:02,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:58:02,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd34d0197af08e45fc58ad/lava_callback.json.gz 2026-05-08 00:58:02,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:02,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd34d0197af08e45fc58ad HTTP/1.1" 200 None 2026-05-08 00:58:02,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:02,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:58:02,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:02,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd34d0197af08e45fc58ad HTTP/1.1" 200 None 2026-05-08 00:58:02,770 - lava_callback - INFO - Completed processing callback for node 69fd34d0197af08e45fc58ad INFO: 172.20.0.1:34970 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:58:08,374 - lava_callback - INFO - Received callback for node 69fd31cd197af08e45fc56c4 INFO: 172.20.0.1:34980 - "POST /node/69fd31cd197af08e45fc56c4 HTTP/1.0" 202 Accepted 2026-05-08 00:58:08,380 - lava_callback - INFO - Starting async job submit for node 69fd31cd197af08e45fc56c4 2026-05-08 00:58:08,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:08,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31cd197af08e45fc56c4 HTTP/1.1" 200 None 2026-05-08 00:58:08,420 - lava_callback - DEBUG - Processing node 69fd31cd197af08e45fc56c4: ltp-watchqueue 2026-05-08 00:58:08,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:58:08,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:58:08,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fd31cd197af08e45fc56c4/log.txt.gz 2026-05-08 00:58:09,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:58:09,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:58:09,210 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fd31cd197af08e45fc56c4/lava-logs.yaml 2026-05-08 00:58:09,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:58:09,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:58:09,327 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fd31cd197af08e45fc56c4/lava_callback.json.gz 2026-05-08 00:58:09,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:09,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31cd197af08e45fc56c4 HTTP/1.1" 200 None 2026-05-08 00:58:09,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:09,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:58:09,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:09,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31cd197af08e45fc56c4 HTTP/1.1" 200 None 2026-05-08 00:58:09,426 - lava_callback - INFO - Completed processing callback for node 69fd31cd197af08e45fc56c4 INFO: 172.20.0.1:40618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40626 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:58:19,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:19,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 00:58:20,704 - lava_callback - INFO - Received callback for node 69fa9220e18d38d4eb0012f0 INFO: 172.20.0.1:56660 - "POST /node/69fa9220e18d38d4eb0012f0 HTTP/1.0" 202 Accepted 2026-05-08 00:58:20,709 - lava_callback - INFO - Starting async job submit for node 69fa9220e18d38d4eb0012f0 2026-05-08 00:58:20,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:20,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9220e18d38d4eb0012f0 HTTP/1.1" 200 None 2026-05-08 00:58:20,724 - lava_callback - DEBUG - Processing node 69fa9220e18d38d4eb0012f0: baseline-arm-baylibre 2026-05-08 00:58:20,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9220e18d38d4eb0012f0 2026-05-08 00:58:20,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:20,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9220e18d38d4eb0012f0 HTTP/1.1" 200 None 2026-05-08 00:58:20,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:20,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 00:58:20,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:58:20,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9220e18d38d4eb0012f0 HTTP/1.1" 200 None 2026-05-08 00:58:20,777 - lava_callback - ERROR - Error processing callback for node 69fa9220e18d38d4eb0012f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:59:40,684 - lava_callback - INFO - Received callback for node 69fa926be18d38d4eb001314 INFO: 172.20.0.1:54366 - "POST /node/69fa926be18d38d4eb001314 HTTP/1.0" 202 Accepted 2026-05-08 00:59:40,689 - lava_callback - INFO - Starting async job submit for node 69fa926be18d38d4eb001314 2026-05-08 00:59:40,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:40,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa926be18d38d4eb001314 HTTP/1.1" 200 None 2026-05-08 00:59:40,705 - lava_callback - DEBUG - Processing node 69fa926be18d38d4eb001314: baseline-arm-baylibre 2026-05-08 00:59:40,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa926be18d38d4eb001314 2026-05-08 00:59:40,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:40,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa926be18d38d4eb001314 HTTP/1.1" 200 None 2026-05-08 00:59:40,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:40,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 00:59:40,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:40,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa926be18d38d4eb001314 HTTP/1.1" 200 None 2026-05-08 00:59:40,758 - lava_callback - ERROR - Error processing callback for node 69fa926be18d38d4eb001314: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 00:59:42,866 - lava_callback - INFO - Received callback for node 69fd3180197af08e45fc55cb INFO: 172.20.0.1:54378 - "POST /node/69fd3180197af08e45fc55cb HTTP/1.0" 202 Accepted 2026-05-08 00:59:42,877 - lava_callback - INFO - Starting async job submit for node 69fd3180197af08e45fc55cb 2026-05-08 00:59:42,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:42,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3180197af08e45fc55cb HTTP/1.1" 200 None 2026-05-08 00:59:42,989 - lava_callback - DEBUG - Processing node 69fd3180197af08e45fc55cb: baseline-arm 2026-05-08 00:59:43,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:59:43,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:59:43,857 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3180197af08e45fc55cb/log.txt.gz 2026-05-08 00:59:44,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:59:44,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:59:44,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3180197af08e45fc55cb/lava-logs.yaml 2026-05-08 00:59:44,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 00:59:44,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 00:59:44,625 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3180197af08e45fc55cb/lava_callback.json.gz DEBUG: Setup failed for 69fd3180197af08e45fc55cb. Transitting job node result: incomplete -> fail 2026-05-08 00:59:44,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:44,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3180197af08e45fc55cb HTTP/1.1" 200 None 2026-05-08 00:59:44,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:44,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 00:59:44,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:44,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3180197af08e45fc55cb HTTP/1.1" 200 None 2026-05-08 00:59:44,962 - lava_callback - INFO - Completed processing callback for node 69fd3180197af08e45fc55cb INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK 2026-05-08 00:59:49,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 00:59:49,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54482 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:01:20,739 - lava_callback - INFO - Received callback for node 69fa92dae18d38d4eb001341 INFO: 172.20.0.1:52474 - "POST /node/69fa92dae18d38d4eb001341 HTTP/1.0" 202 Accepted 2026-05-08 01:01:20,747 - lava_callback - INFO - Starting async job submit for node 69fa92dae18d38d4eb001341 2026-05-08 01:01:20,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:01:20,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa92dae18d38d4eb001341 HTTP/1.1" 200 None 2026-05-08 01:01:20,783 - lava_callback - DEBUG - Processing node 69fa92dae18d38d4eb001341: baseline-arm-baylibre 2026-05-08 01:01:20,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa92dae18d38d4eb001341 2026-05-08 01:01:20,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:01:20,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa92dae18d38d4eb001341 HTTP/1.1" 200 None 2026-05-08 01:01:20,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:01:20,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 01:01:20,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:01:20,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa92dae18d38d4eb001341 HTTP/1.1" 200 None 2026-05-08 01:01:20,863 - lava_callback - ERROR - Error processing callback for node 69fa92dae18d38d4eb001341: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60524 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:02:40,853 - lava_callback - INFO - Received callback for node 69fa9326e18d38d4eb001363 INFO: 172.20.0.1:36616 - "POST /node/69fa9326e18d38d4eb001363 HTTP/1.0" 202 Accepted 2026-05-08 01:02:40,858 - lava_callback - INFO - Starting async job submit for node 69fa9326e18d38d4eb001363 2026-05-08 01:02:40,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:40,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9326e18d38d4eb001363 HTTP/1.1" 200 None 2026-05-08 01:02:40,875 - lava_callback - DEBUG - Processing node 69fa9326e18d38d4eb001363: baseline-arm-baylibre 2026-05-08 01:02:40,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9326e18d38d4eb001363 2026-05-08 01:02:40,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:40,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9326e18d38d4eb001363 HTTP/1.1" 200 None 2026-05-08 01:02:40,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:40,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 01:02:40,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:40,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9326e18d38d4eb001363 HTTP/1.1" 200 None 2026-05-08 01:02:40,943 - lava_callback - ERROR - Error processing callback for node 69fa9326e18d38d4eb001363: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36624 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:02:50,222 - lava_callback - INFO - Received callback for node 69fd31a4197af08e45fc565f INFO: 172.20.0.1:42338 - "POST /node/69fd31a4197af08e45fc565f HTTP/1.0" 202 Accepted 2026-05-08 01:02:50,271 - lava_callback - INFO - Starting async job submit for node 69fd31a4197af08e45fc565f 2026-05-08 01:02:50,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:50,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31a4197af08e45fc565f HTTP/1.1" 200 None 2026-05-08 01:02:50,344 - lava_callback - DEBUG - Processing node 69fd31a4197af08e45fc565f: baseline-arm-pengutronix 2026-05-08 01:02:50,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:02:50,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:02:50,608 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a4197af08e45fc565f/log.txt.gz 2026-05-08 01:02:50,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:02:50,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:02:50,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a4197af08e45fc565f/lava-logs.yaml 2026-05-08 01:02:50,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:02:50,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:02:50,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd31a4197af08e45fc565f/lava_callback.json.gz DEBUG: Setup failed for 69fd31a4197af08e45fc565f. Transitting job node result: incomplete -> fail 2026-05-08 01:02:50,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:50,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31a4197af08e45fc565f HTTP/1.1" 200 None 2026-05-08 01:02:50,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:51,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 01:02:51,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:51,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31a4197af08e45fc565f HTTP/1.1" 200 None 2026-05-08 01:02:51,120 - lava_callback - INFO - Completed processing callback for node 69fd31a4197af08e45fc565f 2026-05-08 01:02:54,389 - lava_callback - INFO - Received callback for node 69fd3634197af08e45fc5971 INFO: 172.20.0.1:42344 - "POST /node/69fd3634197af08e45fc5971 HTTP/1.0" 202 Accepted 2026-05-08 01:02:54,396 - lava_callback - INFO - Starting async job submit for node 69fd3634197af08e45fc5971 2026-05-08 01:02:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:54,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3634197af08e45fc5971 HTTP/1.1" 200 None 2026-05-08 01:02:54,417 - lava_callback - DEBUG - Processing node 69fd3634197af08e45fc5971: baseline-arm 2026-05-08 01:02:54,425 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:02:54,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:02:54,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:02:54,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3634197af08e45fc5971/lava-logs.yaml 2026-05-08 01:02:54,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:02:54,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:02:54,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3634197af08e45fc5971/lava_callback.json.gz 2026-05-08 01:02:54,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:54,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3634197af08e45fc5971 HTTP/1.1" 200 None 2026-05-08 01:02:54,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:54,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 01:02:54,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:02:54,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3634197af08e45fc5971 HTTP/1.1" 200 None 2026-05-08 01:02:54,692 - lava_callback - INFO - Completed processing callback for node 69fd3634197af08e45fc5971 INFO: 172.20.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60014 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:03:19,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:03:19,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:03:57,676 - lava_callback - INFO - Received callback for node 69fa9371e18d38d4eb001381 INFO: 172.20.0.1:57958 - "POST /node/69fa9371e18d38d4eb001381 HTTP/1.0" 202 Accepted 2026-05-08 01:03:57,682 - lava_callback - INFO - Starting async job submit for node 69fa9371e18d38d4eb001381 2026-05-08 01:03:57,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:03:57,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9371e18d38d4eb001381 HTTP/1.1" 200 None 2026-05-08 01:03:57,699 - lava_callback - DEBUG - Processing node 69fa9371e18d38d4eb001381: baseline-arm-clabbe 2026-05-08 01:03:57,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9371e18d38d4eb001381 2026-05-08 01:03:57,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:03:57,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9371e18d38d4eb001381 HTTP/1.1" 200 None 2026-05-08 01:03:57,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:03:57,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 01:03:57,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:03:57,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9371e18d38d4eb001381 HTTP/1.1" 200 None 2026-05-08 01:03:57,761 - lava_callback - ERROR - Error processing callback for node 69fa9371e18d38d4eb001381: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59002 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:04:37,701 - lava_callback - INFO - Received callback for node 69fa9398e18d38d4eb001390 INFO: 172.20.0.1:59012 - "POST /node/69fa9398e18d38d4eb001390 HTTP/1.0" 202 Accepted 2026-05-08 01:04:37,709 - lava_callback - INFO - Starting async job submit for node 69fa9398e18d38d4eb001390 2026-05-08 01:04:37,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:04:37,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9398e18d38d4eb001390 HTTP/1.1" 200 None 2026-05-08 01:04:37,733 - lava_callback - DEBUG - Processing node 69fa9398e18d38d4eb001390: baseline-arm-clabbe 2026-05-08 01:04:37,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9398e18d38d4eb001390 2026-05-08 01:04:37,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:04:37,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9398e18d38d4eb001390 HTTP/1.1" 200 None 2026-05-08 01:04:37,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:04:37,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 01:04:37,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:04:37,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9398e18d38d4eb001390 HTTP/1.1" 200 None 2026-05-08 01:04:37,804 - lava_callback - ERROR - Error processing callback for node 69fa9398e18d38d4eb001390: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45968 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:04:52,544 - lava_callback - INFO - Received callback for node 69fd3697197af08e45fc59d1 INFO: 172.20.0.1:38568 - "POST /node/69fd3697197af08e45fc59d1 HTTP/1.0" 202 Accepted 2026-05-08 01:04:52,551 - lava_callback - INFO - Starting async job submit for node 69fd3697197af08e45fc59d1 2026-05-08 01:04:52,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:04:52,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3697197af08e45fc59d1 HTTP/1.1" 200 None 2026-05-08 01:04:52,602 - lava_callback - DEBUG - Processing node 69fd3697197af08e45fc59d1: baseline-arm64 2026-05-08 01:04:52,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:04:52,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:04:52,920 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3697197af08e45fc59d1/log.txt.gz 2026-05-08 01:04:53,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:04:53,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:04:53,216 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3697197af08e45fc59d1/lava-logs.yaml 2026-05-08 01:04:53,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:04:53,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:04:53,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3697197af08e45fc59d1/lava_callback.json.gz 2026-05-08 01:04:53,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:04:53,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3697197af08e45fc59d1 HTTP/1.1" 200 None 2026-05-08 01:04:53,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:04:53,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:04:53,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:04:53,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3697197af08e45fc59d1 HTTP/1.1" 200 None 2026-05-08 01:04:53,403 - lava_callback - INFO - Completed processing callback for node 69fd3697197af08e45fc59d1 INFO: 172.20.0.1:38572 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:05:03,596 - lava_callback - INFO - Received callback for node 69fd368b197af08e45fc59b0 INFO: 172.20.0.1:55092 - "POST /node/69fd368b197af08e45fc59b0 HTTP/1.0" 202 Accepted 2026-05-08 01:05:03,603 - lava_callback - INFO - Starting async job submit for node 69fd368b197af08e45fc59b0 2026-05-08 01:05:03,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:03,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368b197af08e45fc59b0 HTTP/1.1" 200 None 2026-05-08 01:05:03,641 - lava_callback - DEBUG - Processing node 69fd368b197af08e45fc59b0: baseline-arm64 2026-05-08 01:05:03,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:03,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:03,921 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368b197af08e45fc59b0/log.txt.gz 2026-05-08 01:05:04,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:04,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:04,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368b197af08e45fc59b0/lava-logs.yaml 2026-05-08 01:05:04,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:04,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:04,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368b197af08e45fc59b0/lava_callback.json.gz 2026-05-08 01:05:04,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:04,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368b197af08e45fc59b0 HTTP/1.1" 200 None 2026-05-08 01:05:04,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:04,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:04,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:04,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd368b197af08e45fc59b0 HTTP/1.1" 200 None 2026-05-08 01:05:04,537 - lava_callback - INFO - Completed processing callback for node 69fd368b197af08e45fc59b0 INFO: 172.20.0.1:55096 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:05:06,895 - lava_callback - INFO - Received callback for node 69fd36a5197af08e45fc5a1b INFO: 172.20.0.1:55106 - "POST /node/69fd36a5197af08e45fc5a1b HTTP/1.0" 202 Accepted 2026-05-08 01:05:06,901 - lava_callback - INFO - Starting async job submit for node 69fd36a5197af08e45fc5a1b 2026-05-08 01:05:06,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:06,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a5197af08e45fc5a1b HTTP/1.1" 200 None 2026-05-08 01:05:06,918 - lava_callback - DEBUG - Processing node 69fd36a5197af08e45fc5a1b: baseline-nfs-arm64 2026-05-08 01:05:06,920 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:05:06,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:07,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:07,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a5197af08e45fc5a1b/lava-logs.yaml 2026-05-08 01:05:07,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:07,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:07,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a5197af08e45fc5a1b/lava_callback.json.gz 2026-05-08 01:05:07,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:07,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a5197af08e45fc5a1b HTTP/1.1" 200 None 2026-05-08 01:05:07,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:07,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:07,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:07,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a5197af08e45fc5a1b HTTP/1.1" 200 None 2026-05-08 01:05:07,288 - lava_callback - INFO - Completed processing callback for node 69fd36a5197af08e45fc5a1b INFO: 172.20.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36478 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:05:18,340 - lava_callback - INFO - Received callback for node 69fd3694197af08e45fc59cb INFO: 172.20.0.1:36488 - "POST /node/69fd3694197af08e45fc59cb HTTP/1.0" 202 Accepted 2026-05-08 01:05:18,352 - lava_callback - INFO - Starting async job submit for node 69fd3694197af08e45fc59cb 2026-05-08 01:05:18,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:18,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3694197af08e45fc59cb HTTP/1.1" 200 None 2026-05-08 01:05:18,410 - lava_callback - DEBUG - Processing node 69fd3694197af08e45fc59cb: baseline-arm64 2026-05-08 01:05:18,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:19,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:19,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3694197af08e45fc59cb/log.txt.gz 2026-05-08 01:05:19,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:19,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:19,447 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3694197af08e45fc59cb/lava-logs.yaml 2026-05-08 01:05:19,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:19,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:19,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 01:05:19,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:19,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3694197af08e45fc59cb/lava_callback.json.gz 2026-05-08 01:05:19,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:19,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3694197af08e45fc59cb HTTP/1.1" 200 None 2026-05-08 01:05:19,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:19,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:19,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:19,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3694197af08e45fc59cb HTTP/1.1" 200 None 2026-05-08 01:05:19,661 - lava_callback - INFO - Completed processing callback for node 69fd3694197af08e45fc59cb INFO: 172.20.0.1:35960 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:05:29,210 - lava_callback - INFO - Received callback for node 69fd3692197af08e45fc59c5 INFO: 172.20.0.1:35964 - "POST /node/69fd3692197af08e45fc59c5 HTTP/1.0" 202 Accepted 2026-05-08 01:05:29,217 - lava_callback - INFO - Starting async job submit for node 69fd3692197af08e45fc59c5 2026-05-08 01:05:29,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:29,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3692197af08e45fc59c5 HTTP/1.1" 200 None 2026-05-08 01:05:29,254 - lava_callback - DEBUG - Processing node 69fd3692197af08e45fc59c5: baseline-arm64 2026-05-08 01:05:29,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:29,546 - lava_callback - INFO - Received callback for node 69fd368f197af08e45fc59bc INFO: 172.20.0.1:35972 - "POST /node/69fd368f197af08e45fc59bc HTTP/1.0" 202 Accepted 2026-05-08 01:05:29,554 - lava_callback - INFO - Starting async job submit for node 69fd368f197af08e45fc59bc 2026-05-08 01:05:29,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:29,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:29,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3692197af08e45fc59c5/log.txt.gz 2026-05-08 01:05:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368f197af08e45fc59bc HTTP/1.1" 200 None 2026-05-08 01:05:29,694 - lava_callback - DEBUG - Processing node 69fd368f197af08e45fc59bc: baseline-arm64 2026-05-08 01:05:29,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:29,899 - lava_callback - INFO - Received callback for node 69fd369b197af08e45fc59dd 2026-05-08 01:05:29,905 - lava_callback - INFO - Starting async job submit for node 69fd369b197af08e45fc59dd INFO: 172.20.0.1:41980 - "POST /node/69fd369b197af08e45fc59dd HTTP/1.0" 202 Accepted 2026-05-08 01:05:29,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:29,929 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:05:30,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369b197af08e45fc59dd HTTP/1.1" 200 None 2026-05-08 01:05:30,014 - lava_callback - DEBUG - Processing node 69fd369b197af08e45fc59dd: baseline-arm64 2026-05-08 01:05:30,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:30,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:30,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3692197af08e45fc59c5/lava-logs.yaml 2026-05-08 01:05:30,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:30,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:30,278 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368f197af08e45fc59bc/lava-logs.yaml 2026-05-08 01:05:30,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:30,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:30,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:30,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368f197af08e45fc59bc/lava_callback.json.gz 2026-05-08 01:05:30,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:30,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:30,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:30,419 - lava_callback - INFO - Received callback for node 69fd368d197af08e45fc59b6 2026-05-08 01:05:30,427 - lava_callback - INFO - Starting async job submit for node 69fd368d197af08e45fc59b6 2026-05-08 01:05:30,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369b197af08e45fc59dd/log.txt.gz INFO: 172.20.0.1:41994 - "POST /node/69fd368d197af08e45fc59b6 HTTP/1.0" 202 Accepted 2026-05-08 01:05:30,448 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3692197af08e45fc59c5/lava_callback.json.gz 2026-05-08 01:05:30,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:30,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:30,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368f197af08e45fc59bc HTTP/1.1" 200 None 2026-05-08 01:05:30,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:30,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368d197af08e45fc59b6 HTTP/1.1" 200 None 2026-05-08 01:05:30,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3692197af08e45fc59c5 HTTP/1.1" 200 None 2026-05-08 01:05:30,614 - lava_callback - DEBUG - Processing node 69fd368d197af08e45fc59b6: baseline-arm64 2026-05-08 01:05:30,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:30,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:30,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:30,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:30,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:30,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:30,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd368f197af08e45fc59bc HTTP/1.1" 200 None 2026-05-08 01:05:30,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3692197af08e45fc59c5 HTTP/1.1" 200 None 2026-05-08 01:05:30,908 - lava_callback - INFO - Completed processing callback for node 69fd3692197af08e45fc59c5 2026-05-08 01:05:30,927 - lava_callback - INFO - Completed processing callback for node 69fd368f197af08e45fc59bc 2026-05-08 01:05:31,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:31,039 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369b197af08e45fc59dd/lava-logs.yaml 2026-05-08 01:05:31,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:31,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:31,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:31,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369b197af08e45fc59dd/lava_callback.json.gz 2026-05-08 01:05:31,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:31,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369b197af08e45fc59dd HTTP/1.1" 200 None 2026-05-08 01:05:31,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:31,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:31,376 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368d197af08e45fc59b6/log.txt.gz 2026-05-08 01:05:31,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:31,435 - lava_callback - INFO - Received callback for node 69fd3693197af08e45fc59c8 INFO: 172.20.0.1:42002 - "POST /node/69fd3693197af08e45fc59c8 HTTP/1.0" 202 Accepted 2026-05-08 01:05:31,451 - lava_callback - INFO - Starting async job submit for node 69fd3693197af08e45fc59c8 2026-05-08 01:05:31,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:31,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:31,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3693197af08e45fc59c8 HTTP/1.1" 200 None 2026-05-08 01:05:31,593 - lava_callback - DEBUG - Processing node 69fd3693197af08e45fc59c8: baseline-arm64 2026-05-08 01:05:31,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd369b197af08e45fc59dd HTTP/1.1" 200 None 2026-05-08 01:05:31,607 - lava_callback - INFO - Completed processing callback for node 69fd369b197af08e45fc59dd 2026-05-08 01:05:31,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:32,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:32,071 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368d197af08e45fc59b6/lava-logs.yaml 2026-05-08 01:05:32,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:32,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:32,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:32,291 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368d197af08e45fc59b6/lava_callback.json.gz 2026-05-08 01:05:32,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:32,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:32,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3693197af08e45fc59c8/log.txt.gz 2026-05-08 01:05:32,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368d197af08e45fc59b6 HTTP/1.1" 200 None 2026-05-08 01:05:32,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:32,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:32,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:32,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:32,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd368d197af08e45fc59b6 HTTP/1.1" 200 None 2026-05-08 01:05:32,578 - lava_callback - INFO - Completed processing callback for node 69fd368d197af08e45fc59b6 2026-05-08 01:05:32,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:32,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3693197af08e45fc59c8/lava-logs.yaml 2026-05-08 01:05:32,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:32,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:32,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3693197af08e45fc59c8/lava_callback.json.gz 2026-05-08 01:05:32,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:32,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3693197af08e45fc59c8 HTTP/1.1" 200 None 2026-05-08 01:05:32,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:32,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:32,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:32,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3693197af08e45fc59c8 HTTP/1.1" 200 None 2026-05-08 01:05:32,990 - lava_callback - INFO - Completed processing callback for node 69fd3693197af08e45fc59c8 INFO: 172.20.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42022 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:05:39,186 - lava_callback - INFO - Received callback for node 69fd3696197af08e45fc59ce INFO: 172.20.0.1:42038 - "POST /node/69fd3696197af08e45fc59ce HTTP/1.0" 202 Accepted 2026-05-08 01:05:39,193 - lava_callback - INFO - Starting async job submit for node 69fd3696197af08e45fc59ce 2026-05-08 01:05:39,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:39,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3696197af08e45fc59ce HTTP/1.1" 200 None 2026-05-08 01:05:39,237 - lava_callback - DEBUG - Processing node 69fd3696197af08e45fc59ce: baseline-arm64 2026-05-08 01:05:39,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:39,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:39,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3696197af08e45fc59ce/log.txt.gz 2026-05-08 01:05:40,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:40,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:40,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3696197af08e45fc59ce/lava-logs.yaml 2026-05-08 01:05:40,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:40,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:40,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3696197af08e45fc59ce/lava_callback.json.gz 2026-05-08 01:05:40,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:40,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3696197af08e45fc59ce HTTP/1.1" 200 None 2026-05-08 01:05:40,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:40,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:40,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:40,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3696197af08e45fc59ce HTTP/1.1" 200 None 2026-05-08 01:05:40,591 - lava_callback - INFO - Completed processing callback for node 69fd3696197af08e45fc59ce 2026-05-08 01:05:44,757 - lava_callback - INFO - Received callback for node 69fd3698197af08e45fc59d4 INFO: 172.20.0.1:41162 - "POST /node/69fd3698197af08e45fc59d4 HTTP/1.0" 202 Accepted 2026-05-08 01:05:44,764 - lava_callback - INFO - Starting async job submit for node 69fd3698197af08e45fc59d4 2026-05-08 01:05:44,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:44,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3698197af08e45fc59d4 HTTP/1.1" 200 None 2026-05-08 01:05:44,820 - lava_callback - DEBUG - Processing node 69fd3698197af08e45fc59d4: baseline-arm64 2026-05-08 01:05:45,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:45,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:45,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3698197af08e45fc59d4/log.txt.gz 2026-05-08 01:05:45,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:45,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:45,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3698197af08e45fc59d4/lava-logs.yaml 2026-05-08 01:05:45,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:45,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:45,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3698197af08e45fc59d4/lava_callback.json.gz 2026-05-08 01:05:45,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:45,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3698197af08e45fc59d4 HTTP/1.1" 200 None 2026-05-08 01:05:45,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:45,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:45,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:45,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3698197af08e45fc59d4 HTTP/1.1" 200 None 2026-05-08 01:05:45,728 - lava_callback - INFO - Completed processing callback for node 69fd3698197af08e45fc59d4 INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:05:48,136 - lava_callback - INFO - Received callback for node 69fd368e197af08e45fc59b9 INFO: 172.20.0.1:41176 - "POST /node/69fd368e197af08e45fc59b9 HTTP/1.0" 202 Accepted 2026-05-08 01:05:48,151 - lava_callback - INFO - Starting async job submit for node 69fd368e197af08e45fc59b9 2026-05-08 01:05:48,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:48,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368e197af08e45fc59b9 HTTP/1.1" 200 None 2026-05-08 01:05:48,238 - lava_callback - DEBUG - Processing node 69fd368e197af08e45fc59b9: baseline-arm64 2026-05-08 01:05:48,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:48,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:48,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368e197af08e45fc59b9/log.txt.gz 2026-05-08 01:05:48,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:48,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:48,975 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368e197af08e45fc59b9/lava-logs.yaml 2026-05-08 01:05:48,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:49,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:49,093 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368e197af08e45fc59b9/lava_callback.json.gz 2026-05-08 01:05:49,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:49,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368e197af08e45fc59b9 HTTP/1.1" 200 None 2026-05-08 01:05:49,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:49,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:49,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:49,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd368e197af08e45fc59b9 HTTP/1.1" 200 None 2026-05-08 01:05:49,173 - lava_callback - INFO - Completed processing callback for node 69fd368e197af08e45fc59b9 2026-05-08 01:05:49,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:49,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 01:05:49,705 - lava_callback - INFO - Received callback for node 69fd368c197af08e45fc59b3 INFO: 172.20.0.1:57738 - "POST /node/69fd368c197af08e45fc59b3 HTTP/1.0" 202 Accepted 2026-05-08 01:05:49,711 - lava_callback - INFO - Starting async job submit for node 69fd368c197af08e45fc59b3 2026-05-08 01:05:49,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:49,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368c197af08e45fc59b3 HTTP/1.1" 200 None 2026-05-08 01:05:49,760 - lava_callback - DEBUG - Processing node 69fd368c197af08e45fc59b3: baseline-arm64 2026-05-08 01:05:49,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:50,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:50,085 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368c197af08e45fc59b3/log.txt.gz 2026-05-08 01:05:50,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:50,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:50,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368c197af08e45fc59b3/lava-logs.yaml 2026-05-08 01:05:50,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:50,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:50,509 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd368c197af08e45fc59b3/lava_callback.json.gz 2026-05-08 01:05:50,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:50,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd368c197af08e45fc59b3 HTTP/1.1" 200 None 2026-05-08 01:05:50,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:50,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:50,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:50,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd368c197af08e45fc59b3 HTTP/1.1" 200 None 2026-05-08 01:05:50,610 - lava_callback - INFO - Completed processing callback for node 69fd368c197af08e45fc59b3 2026-05-08 01:05:54,441 - lava_callback - INFO - Received callback for node 69fd369a197af08e45fc59da INFO: 172.20.0.1:57752 - "POST /node/69fd369a197af08e45fc59da HTTP/1.0" 202 Accepted 2026-05-08 01:05:54,451 - lava_callback - INFO - Starting async job submit for node 69fd369a197af08e45fc59da 2026-05-08 01:05:54,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:54,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369a197af08e45fc59da HTTP/1.1" 200 None 2026-05-08 01:05:54,499 - lava_callback - DEBUG - Processing node 69fd369a197af08e45fc59da: baseline-arm64 2026-05-08 01:05:54,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:54,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:54,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369a197af08e45fc59da/log.txt.gz 2026-05-08 01:05:55,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:55,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:55,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369a197af08e45fc59da/lava-logs.yaml 2026-05-08 01:05:55,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:55,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:55,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369a197af08e45fc59da/lava_callback.json.gz 2026-05-08 01:05:55,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:55,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369a197af08e45fc59da HTTP/1.1" 200 None 2026-05-08 01:05:55,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:55,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:55,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:55,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd369a197af08e45fc59da HTTP/1.1" 200 None 2026-05-08 01:05:55,474 - lava_callback - INFO - Completed processing callback for node 69fd369a197af08e45fc59da 2026-05-08 01:05:55,580 - lava_callback - INFO - Received callback for node 69fd36a3197af08e45fc5a14 INFO: 172.20.0.1:57756 - "POST /node/69fd36a3197af08e45fc5a14 HTTP/1.0" 202 Accepted 2026-05-08 01:05:55,588 - lava_callback - INFO - Starting async job submit for node 69fd36a3197af08e45fc5a14 2026-05-08 01:05:55,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:55,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a3197af08e45fc5a14 HTTP/1.1" 200 None 2026-05-08 01:05:55,672 - lava_callback - DEBUG - Processing node 69fd36a3197af08e45fc5a14: baseline-nfs-arm64 2026-05-08 01:05:56,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:56,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:56,382 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a3197af08e45fc5a14/log.txt.gz INFO: 172.20.0.1:57762 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:05:56,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:56,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:56,865 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a3197af08e45fc5a14/lava-logs.yaml 2026-05-08 01:05:56,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:05:57,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:05:57,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a3197af08e45fc5a14/lava_callback.json.gz 2026-05-08 01:05:57,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:57,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a3197af08e45fc5a14 HTTP/1.1" 200 None 2026-05-08 01:05:57,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:57,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:05:57,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:57,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a3197af08e45fc5a14 HTTP/1.1" 200 None 2026-05-08 01:05:57,109 - lava_callback - INFO - Completed processing callback for node 69fd36a3197af08e45fc5a14 2026-05-08 01:05:57,702 - lava_callback - INFO - Received callback for node 69fa93e4e18d38d4eb0013a5 INFO: 172.20.0.1:57768 - "POST /node/69fa93e4e18d38d4eb0013a5 HTTP/1.0" 202 Accepted 2026-05-08 01:05:57,710 - lava_callback - INFO - Starting async job submit for node 69fa93e4e18d38d4eb0013a5 2026-05-08 01:05:57,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:57,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa93e4e18d38d4eb0013a5 HTTP/1.1" 200 None 2026-05-08 01:05:57,727 - lava_callback - DEBUG - Processing node 69fa93e4e18d38d4eb0013a5: baseline-arm-clabbe 2026-05-08 01:05:57,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa93e4e18d38d4eb0013a5 2026-05-08 01:05:57,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:57,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa93e4e18d38d4eb0013a5 HTTP/1.1" 200 None 2026-05-08 01:05:57,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:57,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 01:05:57,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:05:57,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa93e4e18d38d4eb0013a5 HTTP/1.1" 200 None 2026-05-08 01:05:57,782 - lava_callback - ERROR - Error processing callback for node 69fa93e4e18d38d4eb0013a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:06:04,322 - lava_callback - INFO - Received callback for node 69fd369c197af08e45fc59e0 INFO: 172.20.0.1:44748 - "POST /node/69fd369c197af08e45fc59e0 HTTP/1.0" 202 Accepted 2026-05-08 01:06:04,329 - lava_callback - INFO - Starting async job submit for node 69fd369c197af08e45fc59e0 2026-05-08 01:06:04,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:04,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369c197af08e45fc59e0 HTTP/1.1" 200 None 2026-05-08 01:06:04,380 - lava_callback - DEBUG - Processing node 69fd369c197af08e45fc59e0: baseline-arm64 2026-05-08 01:06:04,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:04,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:04,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369c197af08e45fc59e0/log.txt.gz 2026-05-08 01:06:05,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:05,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:05,170 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369c197af08e45fc59e0/lava-logs.yaml 2026-05-08 01:06:05,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:05,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:05,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369c197af08e45fc59e0/lava_callback.json.gz 2026-05-08 01:06:05,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:05,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369c197af08e45fc59e0 HTTP/1.1" 200 None 2026-05-08 01:06:05,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:05,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:05,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:05,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd369c197af08e45fc59e0 HTTP/1.1" 200 None 2026-05-08 01:06:05,432 - lava_callback - INFO - Completed processing callback for node 69fd369c197af08e45fc59e0 INFO: 172.20.0.1:44750 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:06:08,384 - lava_callback - INFO - Received callback for node 69fd36a4197af08e45fc5a17 INFO: 172.20.0.1:44758 - "POST /node/69fd36a4197af08e45fc5a17 HTTP/1.0" 202 Accepted 2026-05-08 01:06:08,391 - lava_callback - INFO - Starting async job submit for node 69fd36a4197af08e45fc5a17 2026-05-08 01:06:08,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:08,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a4197af08e45fc5a17 HTTP/1.1" 200 None 2026-05-08 01:06:08,435 - lava_callback - DEBUG - Processing node 69fd36a4197af08e45fc5a17: baseline-nfs-arm64 2026-05-08 01:06:09,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:09,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:09,101 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a4197af08e45fc5a17/log.txt.gz 2026-05-08 01:06:09,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:09,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:09,596 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a4197af08e45fc5a17/lava-logs.yaml 2026-05-08 01:06:09,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:09,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:09,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a4197af08e45fc5a17/lava_callback.json.gz 2026-05-08 01:06:09,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:09,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a4197af08e45fc5a17 HTTP/1.1" 200 None 2026-05-08 01:06:09,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:09,802 - lava_callback - INFO - Received callback for node 69fd36ab197af08e45fc5a2c INFO: 172.20.0.1:33878 - "POST /node/69fd36ab197af08e45fc5a2c HTTP/1.0" 202 Accepted 2026-05-08 01:06:09,809 - lava_callback - INFO - Starting async job submit for node 69fd36ab197af08e45fc5a2c 2026-05-08 01:06:09,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:09,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:09,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:09,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36ab197af08e45fc5a2c HTTP/1.1" 200 None 2026-05-08 01:06:09,850 - lava_callback - DEBUG - Processing node 69fd36ab197af08e45fc5a2c: baseline-nfs-arm64 2026-05-08 01:06:09,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a4197af08e45fc5a17 HTTP/1.1" 200 None 2026-05-08 01:06:09,943 - lava_callback - INFO - Completed processing callback for node 69fd36a4197af08e45fc5a17 2026-05-08 01:06:10,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:10,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:10,544 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36ab197af08e45fc5a2c/log.txt.gz 2026-05-08 01:06:10,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:10,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:10,999 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36ab197af08e45fc5a2c/lava-logs.yaml 2026-05-08 01:06:11,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:11,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:11,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36ab197af08e45fc5a2c/lava_callback.json.gz 2026-05-08 01:06:11,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:11,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36ab197af08e45fc5a2c HTTP/1.1" 200 None 2026-05-08 01:06:11,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:11,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:11,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:11,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36ab197af08e45fc5a2c HTTP/1.1" 200 None 2026-05-08 01:06:11,246 - lava_callback - INFO - Completed processing callback for node 69fd36ab197af08e45fc5a2c 2026-05-08 01:06:12,676 - lava_callback - INFO - Received callback for node 69fd36cd197af08e45fc5aa8 INFO: 172.20.0.1:33892 - "POST /node/69fd36cd197af08e45fc5aa8 HTTP/1.0" 202 Accepted 2026-05-08 01:06:12,682 - lava_callback - INFO - Starting async job submit for node 69fd36cd197af08e45fc5aa8 2026-05-08 01:06:12,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:12,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36cd197af08e45fc5aa8 HTTP/1.1" 200 None 2026-05-08 01:06:12,732 - lava_callback - DEBUG - Processing node 69fd36cd197af08e45fc5aa8: baseline-arm64-foundriesio 2026-05-08 01:06:12,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:13,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:13,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd36cd197af08e45fc5aa8/log.txt.gz 2026-05-08 01:06:13,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:13,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:13,309 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd36cd197af08e45fc5aa8/lava-logs.yaml 2026-05-08 01:06:13,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:13,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:13,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd36cd197af08e45fc5aa8/lava_callback.json.gz 2026-05-08 01:06:13,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:13,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36cd197af08e45fc5aa8 HTTP/1.1" 200 None 2026-05-08 01:06:13,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:13,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:13,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:13,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36cd197af08e45fc5aa8 HTTP/1.1" 200 None 2026-05-08 01:06:13,505 - lava_callback - INFO - Completed processing callback for node 69fd36cd197af08e45fc5aa8 INFO: 172.20.0.1:33904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33912 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:06:18,442 - lava_callback - INFO - Received callback for node 69fd36a9197af08e45fc5a29 INFO: 172.20.0.1:33926 - "POST /node/69fd36a9197af08e45fc5a29 HTTP/1.0" 202 Accepted 2026-05-08 01:06:18,449 - lava_callback - INFO - Starting async job submit for node 69fd36a9197af08e45fc5a29 2026-05-08 01:06:18,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:18,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a9197af08e45fc5a29 HTTP/1.1" 200 None 2026-05-08 01:06:18,486 - lava_callback - DEBUG - Processing node 69fd36a9197af08e45fc5a29: baseline-nfs-arm64 2026-05-08 01:06:18,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:18,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:18,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a9197af08e45fc5a29/log.txt.gz 2026-05-08 01:06:19,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:19,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:19,231 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a9197af08e45fc5a29/lava-logs.yaml 2026-05-08 01:06:19,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:19,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:19,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a9197af08e45fc5a29/lava_callback.json.gz 2026-05-08 01:06:19,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:19,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a9197af08e45fc5a29 HTTP/1.1" 200 None 2026-05-08 01:06:19,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:19,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:19,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:19,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a9197af08e45fc5a29 HTTP/1.1" 200 None 2026-05-08 01:06:19,411 - lava_callback - INFO - Completed processing callback for node 69fd36a9197af08e45fc5a29 2026-05-08 01:06:19,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:19,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 01:06:20,027 - lava_callback - INFO - Received callback for node 69fd3690197af08e45fc59bf INFO: 172.20.0.1:36278 - "POST /node/69fd3690197af08e45fc59bf HTTP/1.0" 202 Accepted 2026-05-08 01:06:20,034 - lava_callback - INFO - Starting async job submit for node 69fd3690197af08e45fc59bf 2026-05-08 01:06:20,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:20,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3690197af08e45fc59bf HTTP/1.1" 200 None 2026-05-08 01:06:20,094 - lava_callback - DEBUG - Processing node 69fd3690197af08e45fc59bf: baseline-arm64 2026-05-08 01:06:20,175 - lava_callback - INFO - Received callback for node 69fd36a8197af08e45fc5a26 INFO: 172.20.0.1:36286 - "POST /node/69fd36a8197af08e45fc5a26 HTTP/1.0" 202 Accepted 2026-05-08 01:06:20,206 - lava_callback - INFO - Starting async job submit for node 69fd36a8197af08e45fc5a26 2026-05-08 01:06:20,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:20,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a8197af08e45fc5a26 HTTP/1.1" 200 None 2026-05-08 01:06:20,344 - lava_callback - DEBUG - Processing node 69fd36a8197af08e45fc5a26: baseline-nfs-arm64 2026-05-08 01:06:20,498 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:06:20,702 - lava_callback - INFO - Received callback for node 69fd36a6197af08e45fc5a20 INFO: 172.20.0.1:36288 - "POST /node/69fd36a6197af08e45fc5a20 HTTP/1.0" 202 Accepted 2026-05-08 01:06:20,728 - lava_callback - INFO - Starting async job submit for node 69fd36a6197af08e45fc5a20 2026-05-08 01:06:20,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:20,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:20,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a6197af08e45fc5a20 HTTP/1.1" 200 None 2026-05-08 01:06:20,920 - lava_callback - DEBUG - Processing node 69fd36a6197af08e45fc5a20: baseline-nfs-arm64 2026-05-08 01:06:21,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:21,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:21,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3690197af08e45fc59bf/lava-logs.yaml 2026-05-08 01:06:21,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:21,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:21,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a8197af08e45fc5a26/log.txt.gz 2026-05-08 01:06:21,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:21,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:21,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3690197af08e45fc59bf/lava_callback.json.gz 2026-05-08 01:06:21,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:21,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:21,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:21,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a6197af08e45fc5a20/log.txt.gz 2026-05-08 01:06:21,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3690197af08e45fc59bf HTTP/1.1" 200 None 2026-05-08 01:06:21,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:21,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:21,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:21,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:21,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:21,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a8197af08e45fc5a26/lava-logs.yaml 2026-05-08 01:06:21,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:21,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3690197af08e45fc59bf HTTP/1.1" 200 None 2026-05-08 01:06:21,921 - lava_callback - INFO - Completed processing callback for node 69fd3690197af08e45fc59bf 2026-05-08 01:06:22,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:22,004 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a6197af08e45fc5a20/lava-logs.yaml 2026-05-08 01:06:22,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:22,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:22,038 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a8197af08e45fc5a26/lava_callback.json.gz 2026-05-08 01:06:22,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:22,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a8197af08e45fc5a26 HTTP/1.1" 200 None 2026-05-08 01:06:22,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:22,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:22,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:22,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a8197af08e45fc5a26 HTTP/1.1" 200 None 2026-05-08 01:06:22,125 - lava_callback - INFO - Completed processing callback for node 69fd36a8197af08e45fc5a26 2026-05-08 01:06:22,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:22,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a6197af08e45fc5a20/lava_callback.json.gz 2026-05-08 01:06:22,192 - lava_callback - INFO - Received callback for node 69fd36c9197af08e45fc5a9f INFO: 172.20.0.1:36302 - "POST /node/69fd36c9197af08e45fc5a9f HTTP/1.0" 202 Accepted 2026-05-08 01:06:22,204 - lava_callback - INFO - Starting async job submit for node 69fd36c9197af08e45fc5a9f 2026-05-08 01:06:22,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:22,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:22,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a6197af08e45fc5a20 HTTP/1.1" 200 None 2026-05-08 01:06:22,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:22,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c9197af08e45fc5a9f HTTP/1.1" 200 None 2026-05-08 01:06:22,254 - lava_callback - DEBUG - Processing node 69fd36c9197af08e45fc5a9f: baseline-arm64-pengutronix 2026-05-08 01:06:22,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:22,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:22,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a6197af08e45fc5a20 HTTP/1.1" 200 None 2026-05-08 01:06:22,469 - lava_callback - INFO - Completed processing callback for node 69fd36a6197af08e45fc5a20 2026-05-08 01:06:22,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:22,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:22,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36c9197af08e45fc5a9f/log.txt.gz 2026-05-08 01:06:22,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:22,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:22,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36c9197af08e45fc5a9f/lava-logs.yaml 2026-05-08 01:06:22,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:22,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:22,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36c9197af08e45fc5a9f/lava_callback.json.gz 2026-05-08 01:06:23,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:23,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c9197af08e45fc5a9f HTTP/1.1" 200 None 2026-05-08 01:06:23,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:23,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:23,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:23,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c9197af08e45fc5a9f HTTP/1.1" 200 None 2026-05-08 01:06:23,068 - lava_callback - INFO - Completed processing callback for node 69fd36c9197af08e45fc5a9f INFO: 172.20.0.1:36314 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:06:30,302 - lava_callback - INFO - Received callback for node 69fd36cb197af08e45fc5aa2 INFO: 172.20.0.1:47320 - "POST /node/69fd36cb197af08e45fc5aa2 HTTP/1.0" 202 Accepted 2026-05-08 01:06:30,310 - lava_callback - INFO - Starting async job submit for node 69fd36cb197af08e45fc5aa2 2026-05-08 01:06:30,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:30,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36cb197af08e45fc5aa2 HTTP/1.1" 200 None 2026-05-08 01:06:30,369 - lava_callback - DEBUG - Processing node 69fd36cb197af08e45fc5aa2: baseline-arm64-pengutronix 2026-05-08 01:06:30,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:30,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:30,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36cb197af08e45fc5aa2/log.txt.gz 2026-05-08 01:06:30,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:31,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:31,053 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36cb197af08e45fc5aa2/lava-logs.yaml 2026-05-08 01:06:31,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:31,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:31,150 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36cb197af08e45fc5aa2/lava_callback.json.gz 2026-05-08 01:06:31,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:31,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36cb197af08e45fc5aa2 HTTP/1.1" 200 None 2026-05-08 01:06:31,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:31,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:31,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:31,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36cb197af08e45fc5aa2 HTTP/1.1" 200 None 2026-05-08 01:06:31,221 - lava_callback - INFO - Completed processing callback for node 69fd36cb197af08e45fc5aa2 2026-05-08 01:06:32,039 - lava_callback - INFO - Received callback for node 69fd36c8197af08e45fc5a9c INFO: 172.20.0.1:47332 - "POST /node/69fd36c8197af08e45fc5a9c HTTP/1.0" 202 Accepted 2026-05-08 01:06:32,045 - lava_callback - INFO - Starting async job submit for node 69fd36c8197af08e45fc5a9c 2026-05-08 01:06:32,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:32,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c8197af08e45fc5a9c HTTP/1.1" 200 None 2026-05-08 01:06:32,087 - lava_callback - DEBUG - Processing node 69fd36c8197af08e45fc5a9c: baseline-arm64-kontron 2026-05-08 01:06:32,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:32,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:32,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fd36c8197af08e45fc5a9c/log.txt.gz 2026-05-08 01:06:32,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:32,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:32,808 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fd36c8197af08e45fc5a9c/lava-logs.yaml 2026-05-08 01:06:32,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:32,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:32,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fd36c8197af08e45fc5a9c/lava_callback.json.gz 2026-05-08 01:06:32,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:32,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c8197af08e45fc5a9c HTTP/1.1" 200 None 2026-05-08 01:06:32,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:32,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:32,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:33,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c8197af08e45fc5a9c HTTP/1.1" 200 None 2026-05-08 01:06:33,013 - lava_callback - INFO - Completed processing callback for node 69fd36c8197af08e45fc5a9c INFO: 172.20.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47364 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:06:39,815 - lava_callback - INFO - Received callback for node 69fd36cc197af08e45fc5aa5 INFO: 172.20.0.1:53230 - "POST /node/69fd36cc197af08e45fc5aa5 HTTP/1.0" 202 Accepted 2026-05-08 01:06:39,821 - lava_callback - INFO - Starting async job submit for node 69fd36cc197af08e45fc5aa5 2026-05-08 01:06:39,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:39,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36cc197af08e45fc5aa5 HTTP/1.1" 200 None 2026-05-08 01:06:39,861 - lava_callback - DEBUG - Processing node 69fd36cc197af08e45fc5aa5: baseline-arm64-pengutronix 2026-05-08 01:06:40,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:40,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:40,253 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36cc197af08e45fc5aa5/log.txt.gz 2026-05-08 01:06:40,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:40,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:40,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36cc197af08e45fc5aa5/lava-logs.yaml 2026-05-08 01:06:40,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:40,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:40,617 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fd36cc197af08e45fc5aa5/lava_callback.json.gz 2026-05-08 01:06:40,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:40,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36cc197af08e45fc5aa5 HTTP/1.1" 200 None 2026-05-08 01:06:40,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:40,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:40,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:40,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36cc197af08e45fc5aa5 HTTP/1.1" 200 None 2026-05-08 01:06:40,689 - lava_callback - INFO - Completed processing callback for node 69fd36cc197af08e45fc5aa5 2026-05-08 01:06:44,989 - lava_callback - INFO - Received callback for node 69fd369f197af08e45fc59e6 INFO: 172.20.0.1:53242 - "POST /node/69fd369f197af08e45fc59e6 HTTP/1.0" 202 Accepted 2026-05-08 01:06:44,996 - lava_callback - INFO - Starting async job submit for node 69fd369f197af08e45fc59e6 2026-05-08 01:06:45,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:45,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369f197af08e45fc59e6 HTTP/1.1" 200 None 2026-05-08 01:06:45,045 - lava_callback - DEBUG - Processing node 69fd369f197af08e45fc59e6: baseline-nfs-arm64 2026-05-08 01:06:45,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:45,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:45,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd369f197af08e45fc59e6/log.txt.gz 2026-05-08 01:06:45,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:45,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:45,886 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd369f197af08e45fc59e6/lava-logs.yaml 2026-05-08 01:06:45,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:06:46,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:06:46,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd369f197af08e45fc59e6/lava_callback.json.gz 2026-05-08 01:06:46,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:46,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369f197af08e45fc59e6 HTTP/1.1" 200 None 2026-05-08 01:06:46,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:46,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:06:46,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:46,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd369f197af08e45fc59e6 HTTP/1.1" 200 None 2026-05-08 01:06:46,093 - lava_callback - INFO - Completed processing callback for node 69fd369f197af08e45fc59e6 INFO: 172.20.0.1:53248 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:06:49,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:06:49,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41988 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:07:10,062 - lava_callback - INFO - Received callback for node 69fd36a1197af08e45fc59ec INFO: 172.20.0.1:38774 - "POST /node/69fd36a1197af08e45fc59ec HTTP/1.0" 202 Accepted 2026-05-08 01:07:10,072 - lava_callback - INFO - Starting async job submit for node 69fd36a1197af08e45fc59ec 2026-05-08 01:07:10,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:10,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a1197af08e45fc59ec HTTP/1.1" 200 None 2026-05-08 01:07:10,112 - lava_callback - DEBUG - Processing node 69fd36a1197af08e45fc59ec: baseline-nfs-arm64 2026-05-08 01:07:10,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:07:10,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:07:10,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a1197af08e45fc59ec/log.txt.gz 2026-05-08 01:07:10,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:07:11,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:07:11,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a1197af08e45fc59ec/lava-logs.yaml 2026-05-08 01:07:11,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:07:11,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:07:11,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a1197af08e45fc59ec/lava_callback.json.gz 2026-05-08 01:07:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:11,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a1197af08e45fc59ec HTTP/1.1" 200 None 2026-05-08 01:07:11,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:11,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:07:11,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:11,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a1197af08e45fc59ec HTTP/1.1" 200 None 2026-05-08 01:07:11,374 - lava_callback - INFO - Completed processing callback for node 69fd36a1197af08e45fc59ec INFO: 172.20.0.1:38780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38784 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:07:17,857 - lava_callback - INFO - Received callback for node 69fa9431e18d38d4eb0013bc INFO: 172.20.0.1:38794 - "POST /node/69fa9431e18d38d4eb0013bc HTTP/1.0" 202 Accepted 2026-05-08 01:07:17,862 - lava_callback - INFO - Starting async job submit for node 69fa9431e18d38d4eb0013bc 2026-05-08 01:07:17,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:17,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9431e18d38d4eb0013bc HTTP/1.1" 200 None 2026-05-08 01:07:17,877 - lava_callback - DEBUG - Processing node 69fa9431e18d38d4eb0013bc: baseline-arm-clabbe 2026-05-08 01:07:17,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9431e18d38d4eb0013bc 2026-05-08 01:07:17,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:17,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9431e18d38d4eb0013bc HTTP/1.1" 200 None 2026-05-08 01:07:17,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:17,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 01:07:17,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:17,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9431e18d38d4eb0013bc HTTP/1.1" 200 None 2026-05-08 01:07:17,930 - lava_callback - ERROR - Error processing callback for node 69fa9431e18d38d4eb0013bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:07:19,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:19,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 01:07:23,489 - lava_callback - INFO - Received callback for node 69fd36c4197af08e45fc5a93 INFO: 172.20.0.1:45602 - "POST /node/69fd36c4197af08e45fc5a93 HTTP/1.0" 202 Accepted 2026-05-08 01:07:23,495 - lava_callback - INFO - Starting async job submit for node 69fd36c4197af08e45fc5a93 2026-05-08 01:07:23,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:23,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c4197af08e45fc5a93 HTTP/1.1" 200 None 2026-05-08 01:07:23,544 - lava_callback - DEBUG - Processing node 69fd36c4197af08e45fc5a93: baseline-arm64-clabbe 2026-05-08 01:07:23,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:07:23,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:07:23,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fd36c4197af08e45fc5a93/log.txt.gz 2026-05-08 01:07:24,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:07:24,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:07:24,149 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fd36c4197af08e45fc5a93/lava-logs.yaml 2026-05-08 01:07:24,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:07:24,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:07:24,247 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fd36c4197af08e45fc5a93/lava_callback.json.gz 2026-05-08 01:07:24,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:24,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c4197af08e45fc5a93 HTTP/1.1" 200 None 2026-05-08 01:07:24,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:24,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:07:24,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:24,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c4197af08e45fc5a93 HTTP/1.1" 200 None 2026-05-08 01:07:24,322 - lava_callback - INFO - Completed processing callback for node 69fd36c4197af08e45fc5a93 INFO: 172.20.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41926 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:07:49,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:49,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37524 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:07:57,832 - lava_callback - INFO - Received callback for node 69fa9458e18d38d4eb0013c6 INFO: 172.20.0.1:37532 - "POST /node/69fa9458e18d38d4eb0013c6 HTTP/1.0" 202 Accepted 2026-05-08 01:07:57,838 - lava_callback - INFO - Starting async job submit for node 69fa9458e18d38d4eb0013c6 2026-05-08 01:07:57,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:57,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9458e18d38d4eb0013c6 HTTP/1.1" 200 None 2026-05-08 01:07:57,860 - lava_callback - DEBUG - Processing node 69fa9458e18d38d4eb0013c6: baseline-arm-clabbe 2026-05-08 01:07:57,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9458e18d38d4eb0013c6 2026-05-08 01:07:57,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:57,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9458e18d38d4eb0013c6 HTTP/1.1" 200 None 2026-05-08 01:07:57,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:57,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 01:07:57,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:07:57,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9458e18d38d4eb0013c6 HTTP/1.1" 200 None 2026-05-08 01:07:57,909 - lava_callback - ERROR - Error processing callback for node 69fa9458e18d38d4eb0013c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33442 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:08:11,529 - lava_callback - INFO - Received callback for node 69fd3691197af08e45fc59c2 INFO: 172.20.0.1:43884 - "POST /node/69fd3691197af08e45fc59c2 HTTP/1.0" 202 Accepted 2026-05-08 01:08:11,536 - lava_callback - INFO - Starting async job submit for node 69fd3691197af08e45fc59c2 2026-05-08 01:08:11,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:11,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3691197af08e45fc59c2 HTTP/1.1" 200 None 2026-05-08 01:08:11,586 - lava_callback - DEBUG - Processing node 69fd3691197af08e45fc59c2: baseline-arm64 2026-05-08 01:08:11,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:08:12,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:08:12,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3691197af08e45fc59c2/log.txt.gz 2026-05-08 01:08:12,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:08:12,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:08:12,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3691197af08e45fc59c2/lava-logs.yaml 2026-05-08 01:08:12,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:08:12,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:08:12,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3691197af08e45fc59c2/lava_callback.json.gz 2026-05-08 01:08:12,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:12,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3691197af08e45fc59c2 HTTP/1.1" 200 None 2026-05-08 01:08:12,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:12,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:08:12,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:12,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3691197af08e45fc59c2 HTTP/1.1" 200 None 2026-05-08 01:08:12,849 - lava_callback - INFO - Completed processing callback for node 69fd3691197af08e45fc59c2 INFO: 172.20.0.1:43890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43898 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:08:19,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:19,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 01:08:21,153 - lava_callback - INFO - Received callback for node 69fa947fe18d38d4eb001448 INFO: 172.20.0.1:52090 - "POST /node/69fa947fe18d38d4eb001448 HTTP/1.0" 202 Accepted 2026-05-08 01:08:21,159 - lava_callback - INFO - Starting async job submit for node 69fa947fe18d38d4eb001448 2026-05-08 01:08:21,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:21,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa947fe18d38d4eb001448 HTTP/1.1" 200 None 2026-05-08 01:08:21,185 - lava_callback - DEBUG - Processing node 69fa947fe18d38d4eb001448: baseline-arm64-baylibre 2026-05-08 01:08:21,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa947fe18d38d4eb001448 2026-05-08 01:08:21,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:21,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa947fe18d38d4eb001448 HTTP/1.1" 200 None 2026-05-08 01:08:21,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:21,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:21,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:21,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa947fe18d38d4eb001448 HTTP/1.1" 200 None 2026-05-08 01:08:21,233 - lava_callback - ERROR - Error processing callback for node 69fa947fe18d38d4eb001448: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:08:21,813 - lava_callback - INFO - Received callback for node 69fa9481e18d38d4eb00144d INFO: 172.20.0.1:52094 - "POST /node/69fa9481e18d38d4eb00144d HTTP/1.0" 202 Accepted 2026-05-08 01:08:21,819 - lava_callback - INFO - Starting async job submit for node 69fa9481e18d38d4eb00144d 2026-05-08 01:08:21,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:21,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9481e18d38d4eb00144d HTTP/1.1" 200 None 2026-05-08 01:08:21,843 - lava_callback - DEBUG - Processing node 69fa9481e18d38d4eb00144d: baseline-arm64-baylibre 2026-05-08 01:08:21,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9481e18d38d4eb00144d 2026-05-08 01:08:21,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:21,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9481e18d38d4eb00144d HTTP/1.1" 200 None 2026-05-08 01:08:21,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:21,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:21,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:21,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9481e18d38d4eb00144d HTTP/1.1" 200 None 2026-05-08 01:08:21,893 - lava_callback - ERROR - Error processing callback for node 69fa9481e18d38d4eb00144d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:08:22,499 - lava_callback - INFO - Received callback for node 69fa9482e18d38d4eb00146e INFO: 172.20.0.1:52106 - "POST /node/69fa9482e18d38d4eb00146e HTTP/1.0" 202 Accepted 2026-05-08 01:08:22,505 - lava_callback - INFO - Starting async job submit for node 69fa9482e18d38d4eb00146e 2026-05-08 01:08:22,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:22,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9482e18d38d4eb00146e HTTP/1.1" 200 None 2026-05-08 01:08:22,529 - lava_callback - DEBUG - Processing node 69fa9482e18d38d4eb00146e: baseline-arm64-baylibre 2026-05-08 01:08:22,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9482e18d38d4eb00146e 2026-05-08 01:08:22,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:22,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9482e18d38d4eb00146e HTTP/1.1" 200 None 2026-05-08 01:08:22,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:22,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:22,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:22,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9482e18d38d4eb00146e HTTP/1.1" 200 None 2026-05-08 01:08:22,624 - lava_callback - ERROR - Error processing callback for node 69fa9482e18d38d4eb00146e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:08:31,337 - lava_callback - INFO - Received callback for node 69fd36a0197af08e45fc59e9 INFO: 172.20.0.1:43936 - "POST /node/69fd36a0197af08e45fc59e9 HTTP/1.0" 202 Accepted 2026-05-08 01:08:31,348 - lava_callback - INFO - Starting async job submit for node 69fd36a0197af08e45fc59e9 2026-05-08 01:08:31,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:31,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a0197af08e45fc59e9 HTTP/1.1" 200 None 2026-05-08 01:08:31,390 - lava_callback - DEBUG - Processing node 69fd36a0197af08e45fc59e9: baseline-nfs-arm64 2026-05-08 01:08:31,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:08:31,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:08:31,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a0197af08e45fc59e9/log.txt.gz 2026-05-08 01:08:32,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:08:32,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:08:32,345 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a0197af08e45fc59e9/lava-logs.yaml 2026-05-08 01:08:32,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:08:32,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:08:32,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a0197af08e45fc59e9/lava_callback.json.gz 2026-05-08 01:08:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a0197af08e45fc59e9 HTTP/1.1" 200 None 2026-05-08 01:08:32,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:32,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:08:32,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:32,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a0197af08e45fc59e9 HTTP/1.1" 200 None 2026-05-08 01:08:32,581 - lava_callback - INFO - Completed processing callback for node 69fd36a0197af08e45fc59e9 INFO: 172.20.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43956 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:08:38,154 - lava_callback - INFO - Received callback for node 69fa9483e18d38d4eb001471 INFO: 172.20.0.1:43960 - "POST /node/69fa9483e18d38d4eb001471 HTTP/1.0" 202 Accepted 2026-05-08 01:08:38,160 - lava_callback - INFO - Starting async job submit for node 69fa9483e18d38d4eb001471 2026-05-08 01:08:38,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:38,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9483e18d38d4eb001471 HTTP/1.1" 200 None 2026-05-08 01:08:38,182 - lava_callback - DEBUG - Processing node 69fa9483e18d38d4eb001471: baseline-arm-clabbe 2026-05-08 01:08:38,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9483e18d38d4eb001471 2026-05-08 01:08:38,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:38,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9483e18d38d4eb001471 HTTP/1.1" 200 None 2026-05-08 01:08:38,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:38,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 01:08:38,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:38,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9483e18d38d4eb001471 HTTP/1.1" 200 None 2026-05-08 01:08:38,232 - lava_callback - ERROR - Error processing callback for node 69fa9483e18d38d4eb001471: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:08:41,122 - lava_callback - INFO - Received callback for node 69fa9484e18d38d4eb001478 INFO: 172.20.0.1:40282 - "POST /node/69fa9484e18d38d4eb001478 HTTP/1.0" 202 Accepted 2026-05-08 01:08:41,128 - lava_callback - INFO - Starting async job submit for node 69fa9484e18d38d4eb001478 2026-05-08 01:08:41,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:41,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9484e18d38d4eb001478 HTTP/1.1" 200 None 2026-05-08 01:08:41,156 - lava_callback - DEBUG - Processing node 69fa9484e18d38d4eb001478: baseline-arm64-baylibre 2026-05-08 01:08:41,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9484e18d38d4eb001478 2026-05-08 01:08:41,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:41,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9484e18d38d4eb001478 HTTP/1.1" 200 None 2026-05-08 01:08:41,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:41,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:41,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:41,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9484e18d38d4eb001478 HTTP/1.1" 200 None 2026-05-08 01:08:41,229 - lava_callback - ERROR - Error processing callback for node 69fa9484e18d38d4eb001478: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:08:41,779 - lava_callback - INFO - Received callback for node 69fa9486e18d38d4eb00147c INFO: 172.20.0.1:40292 - "POST /node/69fa9486e18d38d4eb00147c HTTP/1.0" 202 Accepted 2026-05-08 01:08:41,785 - lava_callback - INFO - Starting async job submit for node 69fa9486e18d38d4eb00147c 2026-05-08 01:08:41,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:41,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9486e18d38d4eb00147c HTTP/1.1" 200 None 2026-05-08 01:08:41,807 - lava_callback - DEBUG - Processing node 69fa9486e18d38d4eb00147c: baseline-arm64-baylibre 2026-05-08 01:08:41,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9486e18d38d4eb00147c 2026-05-08 01:08:41,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:41,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9486e18d38d4eb00147c HTTP/1.1" 200 None 2026-05-08 01:08:41,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:41,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:41,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:41,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9486e18d38d4eb00147c HTTP/1.1" 200 None 2026-05-08 01:08:41,879 - lava_callback - ERROR - Error processing callback for node 69fa9486e18d38d4eb00147c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:08:42,445 - lava_callback - INFO - Received callback for node 69fa9487e18d38d4eb00147f INFO: 172.20.0.1:40308 - "POST /node/69fa9487e18d38d4eb00147f HTTP/1.0" 202 Accepted 2026-05-08 01:08:42,451 - lava_callback - INFO - Starting async job submit for node 69fa9487e18d38d4eb00147f 2026-05-08 01:08:42,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:42,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9487e18d38d4eb00147f HTTP/1.1" 200 None 2026-05-08 01:08:42,467 - lava_callback - DEBUG - Processing node 69fa9487e18d38d4eb00147f: baseline-arm64-baylibre 2026-05-08 01:08:42,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9487e18d38d4eb00147f 2026-05-08 01:08:42,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:42,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9487e18d38d4eb00147f HTTP/1.1" 200 None 2026-05-08 01:08:42,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:42,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:42,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:42,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9487e18d38d4eb00147f HTTP/1.1" 200 None 2026-05-08 01:08:42,535 - lava_callback - ERROR - Error processing callback for node 69fa9487e18d38d4eb00147f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40324 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:08:49,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:49,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35940 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:08:57,903 - lava_callback - INFO - Received callback for node 69fa9496e18d38d4eb0014a1 INFO: 172.20.0.1:35944 - "POST /node/69fa9496e18d38d4eb0014a1 HTTP/1.0" 202 Accepted 2026-05-08 01:08:57,913 - lava_callback - INFO - Starting async job submit for node 69fa9496e18d38d4eb0014a1 2026-05-08 01:08:57,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:57,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9496e18d38d4eb0014a1 HTTP/1.1" 200 None 2026-05-08 01:08:57,936 - lava_callback - DEBUG - Processing node 69fa9496e18d38d4eb0014a1: baseline-arm64-clabbe 2026-05-08 01:08:57,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9496e18d38d4eb0014a1 2026-05-08 01:08:57,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:57,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9496e18d38d4eb0014a1 HTTP/1.1" 200 None 2026-05-08 01:08:57,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:57,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:57,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:58,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9496e18d38d4eb0014a1 HTTP/1.1" 200 None 2026-05-08 01:08:58,007 - lava_callback - ERROR - Error processing callback for node 69fa9496e18d38d4eb0014a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:08:58,549 - lava_callback - INFO - Received callback for node 69fa9498e18d38d4eb0014a8 INFO: 172.20.0.1:35948 - "POST /node/69fa9498e18d38d4eb0014a8 HTTP/1.0" 202 Accepted 2026-05-08 01:08:58,555 - lava_callback - INFO - Starting async job submit for node 69fa9498e18d38d4eb0014a8 2026-05-08 01:08:58,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:58,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9498e18d38d4eb0014a8 HTTP/1.1" 200 None 2026-05-08 01:08:58,571 - lava_callback - DEBUG - Processing node 69fa9498e18d38d4eb0014a8: baseline-arm64-clabbe 2026-05-08 01:08:58,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9498e18d38d4eb0014a8 2026-05-08 01:08:58,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:58,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9498e18d38d4eb0014a8 HTTP/1.1" 200 None 2026-05-08 01:08:58,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:58,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:58,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:58,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9498e18d38d4eb0014a8 HTTP/1.1" 200 None 2026-05-08 01:08:58,632 - lava_callback - ERROR - Error processing callback for node 69fa9498e18d38d4eb0014a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:08:59,201 - lava_callback - INFO - Received callback for node 69fa9499e18d38d4eb0014ab INFO: 172.20.0.1:35962 - "POST /node/69fa9499e18d38d4eb0014ab HTTP/1.0" 202 Accepted 2026-05-08 01:08:59,207 - lava_callback - INFO - Starting async job submit for node 69fa9499e18d38d4eb0014ab 2026-05-08 01:08:59,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:59,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9499e18d38d4eb0014ab HTTP/1.1" 200 None 2026-05-08 01:08:59,224 - lava_callback - DEBUG - Processing node 69fa9499e18d38d4eb0014ab: baseline-arm64-clabbe 2026-05-08 01:08:59,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9499e18d38d4eb0014ab 2026-05-08 01:08:59,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:59,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9499e18d38d4eb0014ab HTTP/1.1" 200 None 2026-05-08 01:08:59,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:59,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:59,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:59,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9499e18d38d4eb0014ab HTTP/1.1" 200 None 2026-05-08 01:08:59,277 - lava_callback - ERROR - Error processing callback for node 69fa9499e18d38d4eb0014ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:08:59,860 - lava_callback - INFO - Received callback for node 69fa9499e18d38d4eb0014ae INFO: 172.20.0.1:45344 - "POST /node/69fa9499e18d38d4eb0014ae HTTP/1.0" 202 Accepted 2026-05-08 01:08:59,869 - lava_callback - INFO - Starting async job submit for node 69fa9499e18d38d4eb0014ae 2026-05-08 01:08:59,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:59,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9499e18d38d4eb0014ae HTTP/1.1" 200 None 2026-05-08 01:08:59,891 - lava_callback - DEBUG - Processing node 69fa9499e18d38d4eb0014ae: baseline-arm64-clabbe 2026-05-08 01:08:59,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9499e18d38d4eb0014ae 2026-05-08 01:08:59,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:59,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9499e18d38d4eb0014ae HTTP/1.1" 200 None 2026-05-08 01:08:59,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:59,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:08:59,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:08:59,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9499e18d38d4eb0014ae HTTP/1.1" 200 None 2026-05-08 01:08:59,953 - lava_callback - ERROR - Error processing callback for node 69fa9499e18d38d4eb0014ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:09:00,567 - lava_callback - INFO - Received callback for node 69fa949ce18d38d4eb0014b7 INFO: 172.20.0.1:45350 - "POST /node/69fa949ce18d38d4eb0014b7 HTTP/1.0" 202 Accepted 2026-05-08 01:09:00,577 - lava_callback - INFO - Starting async job submit for node 69fa949ce18d38d4eb0014b7 2026-05-08 01:09:00,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:09:00,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa949ce18d38d4eb0014b7 HTTP/1.1" 200 None 2026-05-08 01:09:00,600 - lava_callback - DEBUG - Processing node 69fa949ce18d38d4eb0014b7: baseline-arm64-clabbe 2026-05-08 01:09:00,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa949ce18d38d4eb0014b7 2026-05-08 01:09:00,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:09:00,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa949ce18d38d4eb0014b7 HTTP/1.1" 200 None 2026-05-08 01:09:00,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:09:00,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:09:00,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:09:00,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa949ce18d38d4eb0014b7 HTTP/1.1" 200 None 2026-05-08 01:09:00,738 - lava_callback - ERROR - Error processing callback for node 69fa949ce18d38d4eb0014b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:09:01,218 - lava_callback - INFO - Received callback for node 69fa949be18d38d4eb0014b4 INFO: 172.20.0.1:45356 - "POST /node/69fa949be18d38d4eb0014b4 HTTP/1.0" 202 Accepted 2026-05-08 01:09:01,224 - lava_callback - INFO - Starting async job submit for node 69fa949be18d38d4eb0014b4 2026-05-08 01:09:01,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:09:01,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa949be18d38d4eb0014b4 HTTP/1.1" 200 None 2026-05-08 01:09:01,243 - lava_callback - DEBUG - Processing node 69fa949be18d38d4eb0014b4: baseline-arm64-clabbe 2026-05-08 01:09:01,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa949be18d38d4eb0014b4 2026-05-08 01:09:01,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:09:01,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa949be18d38d4eb0014b4 HTTP/1.1" 200 None 2026-05-08 01:09:01,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:09:01,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 01:09:01,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:09:01,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa949be18d38d4eb0014b4 HTTP/1.1" 200 None 2026-05-08 01:09:01,321 - lava_callback - ERROR - Error processing callback for node 69fa949be18d38d4eb0014b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42334 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:10:01,274 - lava_callback - INFO - Received callback for node 69fa94d5e18d38d4eb00152a INFO: 172.20.0.1:51320 - "POST /node/69fa94d5e18d38d4eb00152a HTTP/1.0" 202 Accepted 2026-05-08 01:10:01,280 - lava_callback - INFO - Starting async job submit for node 69fa94d5e18d38d4eb00152a 2026-05-08 01:10:01,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:10:01,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa94d5e18d38d4eb00152a HTTP/1.1" 200 None 2026-05-08 01:10:01,314 - lava_callback - DEBUG - Processing node 69fa94d5e18d38d4eb00152a: baseline-arm64-baylibre 2026-05-08 01:10:01,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa94d5e18d38d4eb00152a 2026-05-08 01:10:01,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:10:01,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa94d5e18d38d4eb00152a HTTP/1.1" 200 None 2026-05-08 01:10:01,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:10:01,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:10:01,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:10:01,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa94d5e18d38d4eb00152a HTTP/1.1" 200 None 2026-05-08 01:10:01,366 - lava_callback - ERROR - Error processing callback for node 69fa94d5e18d38d4eb00152a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53752 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:10:54,843 - lava_callback - INFO - Received callback for node 69fd3818197af08e45fc5c42 INFO: 172.20.0.1:34704 - "POST /node/69fd3818197af08e45fc5c42 HTTP/1.0" 202 Accepted 2026-05-08 01:10:54,849 - lava_callback - INFO - Starting async job submit for node 69fd3818197af08e45fc5c42 2026-05-08 01:10:54,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:10:54,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3818197af08e45fc5c42 HTTP/1.1" 200 None 2026-05-08 01:10:54,867 - lava_callback - DEBUG - Processing node 69fd3818197af08e45fc5c42: baseline-arm 2026-05-08 01:10:54,873 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:10:54,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:10:54,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:10:54,960 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3818197af08e45fc5c42/lava-logs.yaml 2026-05-08 01:10:54,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:10:55,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:10:55,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3818197af08e45fc5c42/lava_callback.json.gz 2026-05-08 01:10:55,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:10:55,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3818197af08e45fc5c42 HTTP/1.1" 200 None 2026-05-08 01:10:55,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:10:55,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 01:10:55,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:10:55,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3818197af08e45fc5c42 HTTP/1.1" 200 None 2026-05-08 01:10:55,116 - lava_callback - INFO - Completed processing callback for node 69fd3818197af08e45fc5c42 INFO: 172.20.0.1:34716 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:11:01,278 - lava_callback - INFO - Received callback for node 69fa9523e18d38d4eb0015a8 INFO: 172.20.0.1:54046 - "POST /node/69fa9523e18d38d4eb0015a8 HTTP/1.0" 202 Accepted 2026-05-08 01:11:01,285 - lava_callback - INFO - Starting async job submit for node 69fa9523e18d38d4eb0015a8 2026-05-08 01:11:01,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:01,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9523e18d38d4eb0015a8 HTTP/1.1" 200 None 2026-05-08 01:11:01,304 - lava_callback - DEBUG - Processing node 69fa9523e18d38d4eb0015a8: baseline-arm64-baylibre 2026-05-08 01:11:01,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9523e18d38d4eb0015a8 2026-05-08 01:11:01,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:01,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9523e18d38d4eb0015a8 HTTP/1.1" 200 None 2026-05-08 01:11:01,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:01,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:11:01,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:01,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9523e18d38d4eb0015a8 HTTP/1.1" 200 None 2026-05-08 01:11:01,364 - lava_callback - ERROR - Error processing callback for node 69fa9523e18d38d4eb0015a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44404 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:11:19,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:19,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:11:32,306 - lava_callback - INFO - Received callback for node 69fd31c4197af08e45fc56ab INFO: 172.20.0.1:48842 - "POST /node/69fd31c4197af08e45fc56ab HTTP/1.0" 202 Accepted 2026-05-08 01:11:32,354 - lava_callback - INFO - Starting async job submit for node 69fd31c4197af08e45fc56ab 2026-05-08 01:11:32,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:32,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c4197af08e45fc56ab HTTP/1.1" 200 None 2026-05-08 01:11:32,394 - lava_callback - DEBUG - Processing node 69fd31c4197af08e45fc56ab: ltp-pty 2026-05-08 01:11:32,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:11:32,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:11:32,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69fd31c4197af08e45fc56ab/log.txt.gz 2026-05-08 01:11:32,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:11:32,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:11:32,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69fd31c4197af08e45fc56ab/lava-logs.yaml 2026-05-08 01:11:32,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:11:32,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:11:32,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69fd31c4197af08e45fc56ab/lava_callback.json.gz 2026-05-08 01:11:33,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:33,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c4197af08e45fc56ab HTTP/1.1" 200 None 2026-05-08 01:11:33,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:33,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 01:11:33,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:33,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31c4197af08e45fc56ab HTTP/1.1" 200 None 2026-05-08 01:11:33,134 - lava_callback - INFO - Completed processing callback for node 69fd31c4197af08e45fc56ab 2026-05-08 01:11:35,694 - lava_callback - INFO - Received callback for node 69fd36ce197af08e45fc5aab INFO: 172.20.0.1:48858 - "POST /node/69fd36ce197af08e45fc5aab HTTP/1.0" 202 Accepted 2026-05-08 01:11:35,703 - lava_callback - INFO - Starting async job submit for node 69fd36ce197af08e45fc5aab 2026-05-08 01:11:35,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:35,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36ce197af08e45fc5aab HTTP/1.1" 200 None 2026-05-08 01:11:35,775 - lava_callback - DEBUG - Processing node 69fd36ce197af08e45fc5aab: baseline-arm64-foundriesio INFO: 172.20.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48866 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:11:36,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:11:37,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:11:37,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd36ce197af08e45fc5aab/log.txt.gz 2026-05-08 01:11:37,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:11:38,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:11:38,071 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd36ce197af08e45fc5aab/lava-logs.yaml 2026-05-08 01:11:38,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:11:38,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:11:38,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd36ce197af08e45fc5aab/lava_callback.json.gz DEBUG: Setup failed for 69fd36ce197af08e45fc5aab. Transitting job node result: incomplete -> fail 2026-05-08 01:11:38,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:38,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36ce197af08e45fc5aab HTTP/1.1" 200 None 2026-05-08 01:11:38,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:38,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:11:38,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:38,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36ce197af08e45fc5aab HTTP/1.1" 200 None 2026-05-08 01:11:38,553 - lava_callback - INFO - Completed processing callback for node 69fd36ce197af08e45fc5aab INFO: 172.20.0.1:39656 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:11:49,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:11:49,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37430 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:12:12,545 - lava_callback - INFO - Received callback for node 69fd369e197af08e45fc59e3 INFO: 172.20.0.1:39054 - "POST /node/69fd369e197af08e45fc59e3 HTTP/1.0" 202 Accepted 2026-05-08 01:12:12,554 - lava_callback - INFO - Starting async job submit for node 69fd369e197af08e45fc59e3 2026-05-08 01:12:12,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:12,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369e197af08e45fc59e3 HTTP/1.1" 200 None 2026-05-08 01:12:12,617 - lava_callback - DEBUG - Processing node 69fd369e197af08e45fc59e3: baseline-arm64 2026-05-08 01:12:12,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:12:13,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:12:13,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369e197af08e45fc59e3/log.txt.gz 2026-05-08 01:12:13,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:12:13,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:12:13,440 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369e197af08e45fc59e3/lava-logs.yaml 2026-05-08 01:12:13,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:12:13,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:12:13,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd369e197af08e45fc59e3/lava_callback.json.gz DEBUG: Setup failed for 69fd369e197af08e45fc59e3. Transitting job node result: incomplete -> fail 2026-05-08 01:12:13,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:13,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd369e197af08e45fc59e3 HTTP/1.1" 200 None 2026-05-08 01:12:13,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:13,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:12:13,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:13,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd369e197af08e45fc59e3 HTTP/1.1" 200 None 2026-05-08 01:12:13,752 - lava_callback - INFO - Completed processing callback for node 69fd369e197af08e45fc59e3 INFO: 172.20.0.1:39058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39066 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:12:19,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:19,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 01:12:21,369 - lava_callback - INFO - Received callback for node 69fa9571e18d38d4eb00161b INFO: 172.20.0.1:43268 - "POST /node/69fa9571e18d38d4eb00161b HTTP/1.0" 202 Accepted 2026-05-08 01:12:21,375 - lava_callback - INFO - Starting async job submit for node 69fa9571e18d38d4eb00161b 2026-05-08 01:12:21,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:21,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9571e18d38d4eb00161b HTTP/1.1" 200 None 2026-05-08 01:12:21,392 - lava_callback - DEBUG - Processing node 69fa9571e18d38d4eb00161b: baseline-arm64-baylibre 2026-05-08 01:12:21,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9571e18d38d4eb00161b 2026-05-08 01:12:21,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:21,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9571e18d38d4eb00161b HTTP/1.1" 200 None 2026-05-08 01:12:21,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:21,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:12:21,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:12:21,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9571e18d38d4eb00161b HTTP/1.1" 200 None 2026-05-08 01:12:21,455 - lava_callback - ERROR - Error processing callback for node 69fa9571e18d38d4eb00161b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47160 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:13:41,461 - lava_callback - INFO - Received callback for node 69fa95c1e18d38d4eb001650 INFO: 172.20.0.1:32802 - "POST /node/69fa95c1e18d38d4eb001650 HTTP/1.0" 202 Accepted 2026-05-08 01:13:41,466 - lava_callback - INFO - Starting async job submit for node 69fa95c1e18d38d4eb001650 2026-05-08 01:13:41,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:13:41,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa95c1e18d38d4eb001650 HTTP/1.1" 200 None 2026-05-08 01:13:41,481 - lava_callback - DEBUG - Processing node 69fa95c1e18d38d4eb001650: baseline-arm64-baylibre 2026-05-08 01:13:41,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa95c1e18d38d4eb001650 2026-05-08 01:13:41,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:13:41,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa95c1e18d38d4eb001650 HTTP/1.1" 200 None 2026-05-08 01:13:41,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:13:41,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:13:41,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:13:41,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa95c1e18d38d4eb001650 HTTP/1.1" 200 None 2026-05-08 01:13:41,526 - lava_callback - ERROR - Error processing callback for node 69fa95c1e18d38d4eb001650: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:14:42,077 - lava_callback - INFO - Received callback for node 69fd3699197af08e45fc59d7 INFO: 172.20.0.1:50802 - "POST /node/69fd3699197af08e45fc59d7 HTTP/1.0" 202 Accepted 2026-05-08 01:14:42,084 - lava_callback - INFO - Starting async job submit for node 69fd3699197af08e45fc59d7 2026-05-08 01:14:42,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:14:42,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3699197af08e45fc59d7 HTTP/1.1" 200 None 2026-05-08 01:14:42,122 - lava_callback - DEBUG - Processing node 69fd3699197af08e45fc59d7: baseline-arm64 2026-05-08 01:14:42,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:14:42,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:14:42,856 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3699197af08e45fc59d7/log.txt.gz 2026-05-08 01:14:43,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:14:43,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:14:43,351 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3699197af08e45fc59d7/lava-logs.yaml 2026-05-08 01:14:43,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:14:43,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:14:43,514 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3699197af08e45fc59d7/lava_callback.json.gz 2026-05-08 01:14:43,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:14:43,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3699197af08e45fc59d7 HTTP/1.1" 200 None 2026-05-08 01:14:43,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:14:43,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:14:43,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:14:43,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3699197af08e45fc59d7 HTTP/1.1" 200 None 2026-05-08 01:14:43,664 - lava_callback - INFO - Completed processing callback for node 69fd3699197af08e45fc59d7 INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:14:49,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:14:49,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41634 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:15:09,634 - lava_callback - INFO - Received callback for node 69fd36bf197af08e45fc5a57 INFO: 172.20.0.1:41646 - "POST /node/69fd36bf197af08e45fc5a57 HTTP/1.0" 202 Accepted 2026-05-08 01:15:09,640 - lava_callback - INFO - Starting async job submit for node 69fd36bf197af08e45fc5a57 2026-05-08 01:15:09,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:09,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36bf197af08e45fc5a57 HTTP/1.1" 200 None 2026-05-08 01:15:09,676 - lava_callback - DEBUG - Processing node 69fd36bf197af08e45fc5a57: baseline-arm64-broonie 2026-05-08 01:15:09,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:15:10,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:15:10,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36bf197af08e45fc5a57/log.txt.gz 2026-05-08 01:15:10,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:15:10,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:15:10,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36bf197af08e45fc5a57/lava-logs.yaml 2026-05-08 01:15:10,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:15:10,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:15:10,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36bf197af08e45fc5a57/lava_callback.json.gz 2026-05-08 01:15:10,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:10,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36bf197af08e45fc5a57 HTTP/1.1" 200 None 2026-05-08 01:15:10,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:10,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:15:10,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:10,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36bf197af08e45fc5a57 HTTP/1.1" 200 None 2026-05-08 01:15:10,610 - lava_callback - INFO - Completed processing callback for node 69fd36bf197af08e45fc5a57 INFO: 172.20.0.1:36496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36506 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:15:19,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:19,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:15:43,096 - lava_callback - INFO - Received callback for node 69fd36a7197af08e45fc5a23 INFO: 172.20.0.1:34104 - "POST /node/69fd36a7197af08e45fc5a23 HTTP/1.0" 202 Accepted 2026-05-08 01:15:43,103 - lava_callback - INFO - Starting async job submit for node 69fd36a7197af08e45fc5a23 2026-05-08 01:15:43,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:43,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a7197af08e45fc5a23 HTTP/1.1" 200 None 2026-05-08 01:15:43,152 - lava_callback - DEBUG - Processing node 69fd36a7197af08e45fc5a23: baseline-nfs-arm64 2026-05-08 01:15:43,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:15:43,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:15:43,797 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a7197af08e45fc5a23/log.txt.gz 2026-05-08 01:15:44,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:15:44,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:15:44,218 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a7197af08e45fc5a23/lava-logs.yaml 2026-05-08 01:15:44,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:15:44,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:15:44,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a7197af08e45fc5a23/lava_callback.json.gz 2026-05-08 01:15:44,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:44,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a7197af08e45fc5a23 HTTP/1.1" 200 None 2026-05-08 01:15:44,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:44,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:15:44,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:44,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a7197af08e45fc5a23 HTTP/1.1" 200 None 2026-05-08 01:15:44,490 - lava_callback - INFO - Completed processing callback for node 69fd36a7197af08e45fc5a23 INFO: 172.20.0.1:34106 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:15:49,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:15:49,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36978 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:16:27,246 - lava_callback - INFO - Received callback for node 69fd3949197af08e45fc5ced INFO: 172.20.0.1:36980 - "POST /node/69fd3949197af08e45fc5ced HTTP/1.0" 202 Accepted 2026-05-08 01:16:27,253 - lava_callback - INFO - Starting async job submit for node 69fd3949197af08e45fc5ced 2026-05-08 01:16:27,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:16:27,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3949197af08e45fc5ced HTTP/1.1" 200 None 2026-05-08 01:16:27,272 - lava_callback - DEBUG - Processing node 69fd3949197af08e45fc5ced: baseline-nfs-arm64 2026-05-08 01:16:27,273 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:16:27,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:16:27,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:16:27,374 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd3949197af08e45fc5ced/lava-logs.yaml 2026-05-08 01:16:27,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:16:27,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:16:27,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd3949197af08e45fc5ced/lava_callback.json.gz 2026-05-08 01:16:27,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:16:27,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3949197af08e45fc5ced HTTP/1.1" 200 None 2026-05-08 01:16:27,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:16:27,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:16:27,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:16:27,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3949197af08e45fc5ced HTTP/1.1" 200 None 2026-05-08 01:16:27,576 - lava_callback - INFO - Completed processing callback for node 69fd3949197af08e45fc5ced INFO: 172.20.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36528 - "GET /node/6990a98ac45febfe445215ab%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36536 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:16:49,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:16:49,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58406 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:17:12,510 - lava_callback - INFO - Received callback for node 69fd36bc197af08e45fc5a50 INFO: 172.20.0.1:55110 - "POST /node/69fd36bc197af08e45fc5a50 HTTP/1.0" 202 Accepted 2026-05-08 01:17:12,516 - lava_callback - INFO - Starting async job submit for node 69fd36bc197af08e45fc5a50 2026-05-08 01:17:12,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:12,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36bc197af08e45fc5a50 HTTP/1.1" 200 None 2026-05-08 01:17:12,552 - lava_callback - DEBUG - Processing node 69fd36bc197af08e45fc5a50: baseline-arm64-broonie 2026-05-08 01:17:12,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:17:12,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:17:12,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36bc197af08e45fc5a50/log.txt.gz 2026-05-08 01:17:13,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:17:13,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:17:13,207 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36bc197af08e45fc5a50/lava-logs.yaml 2026-05-08 01:17:13,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:17:13,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:17:13,321 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36bc197af08e45fc5a50/lava_callback.json.gz 2026-05-08 01:17:13,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:13,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36bc197af08e45fc5a50 HTTP/1.1" 200 None 2026-05-08 01:17:13,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:13,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:17:13,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:13,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36bc197af08e45fc5a50 HTTP/1.1" 200 None 2026-05-08 01:17:13,400 - lava_callback - INFO - Completed processing callback for node 69fd36bc197af08e45fc5a50 INFO: 172.20.0.1:55116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55130 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:17:19,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:19,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:17:41,758 - lava_callback - INFO - Received callback for node 69fa96a8e18d38d4eb0016e2 INFO: 172.20.0.1:53730 - "POST /node/69fa96a8e18d38d4eb0016e2 HTTP/1.0" 202 Accepted 2026-05-08 01:17:41,764 - lava_callback - INFO - Starting async job submit for node 69fa96a8e18d38d4eb0016e2 2026-05-08 01:17:41,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:41,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa96a8e18d38d4eb0016e2 HTTP/1.1" 200 None 2026-05-08 01:17:41,779 - lava_callback - DEBUG - Processing node 69fa96a8e18d38d4eb0016e2: baseline-arm64-baylibre 2026-05-08 01:17:41,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa96a8e18d38d4eb0016e2 2026-05-08 01:17:41,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:41,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa96a8e18d38d4eb0016e2 HTTP/1.1" 200 None 2026-05-08 01:17:41,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:41,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:17:41,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:17:41,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa96a8e18d38d4eb0016e2 HTTP/1.1" 200 None 2026-05-08 01:17:41,839 - lava_callback - ERROR - Error processing callback for node 69fa96a8e18d38d4eb0016e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:18:10,383 - lava_callback - INFO - Received callback for node 69fd36b4197af08e45fc5a3d INFO: 172.20.0.1:52804 - "POST /node/69fd36b4197af08e45fc5a3d HTTP/1.0" 202 Accepted 2026-05-08 01:18:10,390 - lava_callback - INFO - Starting async job submit for node 69fd36b4197af08e45fc5a3d 2026-05-08 01:18:10,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:10,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b4197af08e45fc5a3d HTTP/1.1" 200 None 2026-05-08 01:18:10,443 - lava_callback - DEBUG - Processing node 69fd36b4197af08e45fc5a3d: baseline-arm64-broonie 2026-05-08 01:18:10,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:18:10,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:18:10,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b4197af08e45fc5a3d/log.txt.gz 2026-05-08 01:18:10,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:18:11,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:18:11,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b4197af08e45fc5a3d/lava-logs.yaml 2026-05-08 01:18:11,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:18:11,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:18:11,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b4197af08e45fc5a3d/lava_callback.json.gz 2026-05-08 01:18:11,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:11,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b4197af08e45fc5a3d HTTP/1.1" 200 None 2026-05-08 01:18:11,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:11,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:18:11,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:11,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36b4197af08e45fc5a3d HTTP/1.1" 200 None 2026-05-08 01:18:11,221 - lava_callback - INFO - Completed processing callback for node 69fd36b4197af08e45fc5a3d INFO: 172.20.0.1:52808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52810 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:18:19,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:19,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35034 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:18:43,182 - lava_callback - INFO - Received callback for node 69fd39ae197af08e45fc5d21 INFO: 172.20.0.1:43880 - "POST /node/69fd39ae197af08e45fc5d21 HTTP/1.0" 202 Accepted 2026-05-08 01:18:43,189 - lava_callback - INFO - Starting async job submit for node 69fd39ae197af08e45fc5d21 2026-05-08 01:18:43,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:43,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd39ae197af08e45fc5d21 HTTP/1.1" 200 None 2026-05-08 01:18:43,249 - lava_callback - DEBUG - Processing node 69fd39ae197af08e45fc5d21: baseline-arm64 2026-05-08 01:18:43,425 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:18:43,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:18:43,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:18:43,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd39ae197af08e45fc5d21/lava-logs.yaml 2026-05-08 01:18:43,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:18:43,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:18:43,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd39ae197af08e45fc5d21/lava_callback.json.gz 2026-05-08 01:18:43,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:43,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd39ae197af08e45fc5d21 HTTP/1.1" 200 None 2026-05-08 01:18:43,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:43,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:18:43,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:43,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd39ae197af08e45fc5d21 HTTP/1.1" 200 None 2026-05-08 01:18:43,954 - lava_callback - INFO - Completed processing callback for node 69fd39ae197af08e45fc5d21 INFO: 172.20.0.1:43884 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:18:49,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:18:49,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50918 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:19:01,699 - lava_callback - INFO - Received callback for node 69fa96f5e18d38d4eb001704 INFO: 172.20.0.1:49546 - "POST /node/69fa96f5e18d38d4eb001704 HTTP/1.0" 202 Accepted 2026-05-08 01:19:01,705 - lava_callback - INFO - Starting async job submit for node 69fa96f5e18d38d4eb001704 2026-05-08 01:19:01,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:19:01,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa96f5e18d38d4eb001704 HTTP/1.1" 200 None 2026-05-08 01:19:01,721 - lava_callback - DEBUG - Processing node 69fa96f5e18d38d4eb001704: baseline-arm64-baylibre 2026-05-08 01:19:01,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa96f5e18d38d4eb001704 2026-05-08 01:19:01,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:19:01,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa96f5e18d38d4eb001704 HTTP/1.1" 200 None 2026-05-08 01:19:01,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:19:01,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:19:01,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:19:01,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa96f5e18d38d4eb001704 HTTP/1.1" 200 None 2026-05-08 01:19:01,768 - lava_callback - ERROR - Error processing callback for node 69fa96f5e18d38d4eb001704: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44512 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:19:49,248 - lava_callback - INFO - Received callback for node 69fd36b8197af08e45fc5a4a INFO: 172.20.0.1:44516 - "POST /node/69fd36b8197af08e45fc5a4a HTTP/1.0" 202 Accepted 2026-05-08 01:19:49,254 - lava_callback - INFO - Starting async job submit for node 69fd36b8197af08e45fc5a4a 2026-05-08 01:19:49,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:19:49,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b8197af08e45fc5a4a HTTP/1.1" 200 None 2026-05-08 01:19:49,291 - lava_callback - DEBUG - Processing node 69fd36b8197af08e45fc5a4a: baseline-arm64-broonie 2026-05-08 01:19:49,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:19:49,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:19:49,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b8197af08e45fc5a4a/log.txt.gz 2026-05-08 01:19:49,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:19:50,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:19:50,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b8197af08e45fc5a4a/lava-logs.yaml 2026-05-08 01:19:50,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:19:50,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:19:50,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b8197af08e45fc5a4a/lava_callback.json.gz 2026-05-08 01:19:50,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:19:50,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b8197af08e45fc5a4a HTTP/1.1" 200 None 2026-05-08 01:19:50,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:19:50,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:19:50,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:19:50,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36b8197af08e45fc5a4a HTTP/1.1" 200 None 2026-05-08 01:19:50,329 - lava_callback - INFO - Completed processing callback for node 69fd36b8197af08e45fc5a4a INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47568 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:20:14,322 - lava_callback - INFO - Received callback for node 69fd39fc197af08e45fc5d51 INFO: 172.20.0.1:36380 - "POST /node/69fd39fc197af08e45fc5d51 HTTP/1.0" 202 Accepted 2026-05-08 01:20:14,329 - lava_callback - INFO - Starting async job submit for node 69fd39fc197af08e45fc5d51 2026-05-08 01:20:14,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:20:14,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd39fc197af08e45fc5d51 HTTP/1.1" 200 None 2026-05-08 01:20:14,365 - lava_callback - DEBUG - Processing node 69fd39fc197af08e45fc5d51: baseline-arm64 2026-05-08 01:20:14,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:20:14,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:20:14,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd39fc197af08e45fc5d51/log.txt.gz INFO: 172.20.0.1:36394 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 01:20:15,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:20:15,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:20:15,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd39fc197af08e45fc5d51/lava-logs.yaml 2026-05-08 01:20:15,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:20:15,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:20:15,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd39fc197af08e45fc5d51/lava_callback.json.gz 2026-05-08 01:20:15,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:20:15,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd39fc197af08e45fc5d51 HTTP/1.1" 200 None 2026-05-08 01:20:15,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:20:15,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:20:15,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:20:15,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd39fc197af08e45fc5d51 HTTP/1.1" 200 None 2026-05-08 01:20:15,699 - lava_callback - INFO - Completed processing callback for node 69fd39fc197af08e45fc5d51 INFO: 172.20.0.1:36402 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:20:19,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:20:19,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54464 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:21:38,357 - lava_callback - INFO - Received callback for node 69fa9791e18d38d4eb00176c INFO: 172.20.0.1:54470 - "POST /node/69fa9791e18d38d4eb00176c HTTP/1.0" 202 Accepted 2026-05-08 01:21:38,362 - lava_callback - INFO - Starting async job submit for node 69fa9791e18d38d4eb00176c 2026-05-08 01:21:38,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:21:38,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9791e18d38d4eb00176c HTTP/1.1" 200 None 2026-05-08 01:21:38,377 - lava_callback - DEBUG - Processing node 69fa9791e18d38d4eb00176c: baseline-arm64-clabbe 2026-05-08 01:21:38,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9791e18d38d4eb00176c 2026-05-08 01:21:38,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:21:38,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9791e18d38d4eb00176c HTTP/1.1" 200 None 2026-05-08 01:21:38,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:21:38,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:21:38,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:21:38,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9791e18d38d4eb00176c HTTP/1.1" 200 None 2026-05-08 01:21:38,428 - lava_callback - ERROR - Error processing callback for node 69fa9791e18d38d4eb00176c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38684 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:21:54,745 - lava_callback - INFO - Received callback for node 69fd3a6e197af08e45fc5d94 INFO: 172.20.0.1:38776 - "POST /node/69fd3a6e197af08e45fc5d94 HTTP/1.0" 202 Accepted 2026-05-08 01:21:54,751 - lava_callback - INFO - Starting async job submit for node 69fd3a6e197af08e45fc5d94 2026-05-08 01:21:54,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:21:54,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3a6e197af08e45fc5d94 HTTP/1.1" 200 None 2026-05-08 01:21:54,786 - lava_callback - DEBUG - Processing node 69fd3a6e197af08e45fc5d94: baseline-arm64 2026-05-08 01:21:55,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:21:55,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:21:55,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3a6e197af08e45fc5d94/log.txt.gz 2026-05-08 01:21:55,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:21:55,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:21:55,759 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3a6e197af08e45fc5d94/lava-logs.yaml 2026-05-08 01:21:55,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:21:55,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:21:55,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3a6e197af08e45fc5d94/lava_callback.json.gz 2026-05-08 01:21:55,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:21:55,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3a6e197af08e45fc5d94 HTTP/1.1" 200 None 2026-05-08 01:21:55,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:21:55,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:21:55,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:21:55,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3a6e197af08e45fc5d94 HTTP/1.1" 200 None 2026-05-08 01:21:55,956 - lava_callback - INFO - Completed processing callback for node 69fd3a6e197af08e45fc5d94 INFO: 172.20.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34002 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:22:19,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:22:19,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57336 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:22:58,394 - lava_callback - INFO - Received callback for node 69fa97dfe18d38d4eb001784 INFO: 172.20.0.1:57344 - "POST /node/69fa97dfe18d38d4eb001784 HTTP/1.0" 202 Accepted 2026-05-08 01:22:58,400 - lava_callback - INFO - Starting async job submit for node 69fa97dfe18d38d4eb001784 2026-05-08 01:22:58,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:22:58,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa97dfe18d38d4eb001784 HTTP/1.1" 200 None 2026-05-08 01:22:58,414 - lava_callback - DEBUG - Processing node 69fa97dfe18d38d4eb001784: baseline-arm64-clabbe 2026-05-08 01:22:58,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa97dfe18d38d4eb001784 2026-05-08 01:22:58,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:22:58,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa97dfe18d38d4eb001784 HTTP/1.1" 200 None 2026-05-08 01:22:58,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:22:58,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:22:58,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:22:58,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa97dfe18d38d4eb001784 HTTP/1.1" 200 None 2026-05-08 01:22:58,459 - lava_callback - ERROR - Error processing callback for node 69fa97dfe18d38d4eb001784: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:23:02,747 - lava_callback - INFO - Received callback for node 69fd3ab6197af08e45fc5db8 INFO: 172.20.0.1:52514 - "POST /node/69fd3ab6197af08e45fc5db8 HTTP/1.0" 202 Accepted 2026-05-08 01:23:02,754 - lava_callback - INFO - Starting async job submit for node 69fd3ab6197af08e45fc5db8 2026-05-08 01:23:02,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:02,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3ab6197af08e45fc5db8 HTTP/1.1" 200 None 2026-05-08 01:23:02,798 - lava_callback - DEBUG - Processing node 69fd3ab6197af08e45fc5db8: baseline-arm64 2026-05-08 01:23:02,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:23:03,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:23:03,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3ab6197af08e45fc5db8/log.txt.gz 2026-05-08 01:23:03,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:23:03,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:23:03,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3ab6197af08e45fc5db8/lava-logs.yaml 2026-05-08 01:23:03,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:23:03,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:23:03,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3ab6197af08e45fc5db8/lava_callback.json.gz 2026-05-08 01:23:03,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:03,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3ab6197af08e45fc5db8 HTTP/1.1" 200 None 2026-05-08 01:23:03,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:03,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:23:03,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:03,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3ab6197af08e45fc5db8 HTTP/1.1" 200 None 2026-05-08 01:23:03,823 - lava_callback - INFO - Completed processing callback for node 69fd3ab6197af08e45fc5db8 INFO: 172.20.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55036 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:23:19,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:20,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55804 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:23:29,378 - lava_callback - INFO - Received callback for node 69fd36eb197af08e45fc5af6 INFO: 172.20.0.1:55818 - "POST /node/69fd36eb197af08e45fc5af6 HTTP/1.0" 202 Accepted 2026-05-08 01:23:29,385 - lava_callback - INFO - Starting async job submit for node 69fd36eb197af08e45fc5af6 2026-05-08 01:23:29,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:29,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36eb197af08e45fc5af6 HTTP/1.1" 200 None 2026-05-08 01:23:29,459 - lava_callback - DEBUG - Processing node 69fd36eb197af08e45fc5af6: ltp-smoke 2026-05-08 01:23:29,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:23:30,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:23:30,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd36eb197af08e45fc5af6/log.txt.gz 2026-05-08 01:23:30,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:23:30,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:23:30,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd36eb197af08e45fc5af6/lava-logs.yaml 2026-05-08 01:23:30,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:23:30,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:23:30,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd36eb197af08e45fc5af6/lava_callback.json.gz 2026-05-08 01:23:30,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:30,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36eb197af08e45fc5af6 HTTP/1.1" 200 None 2026-05-08 01:23:30,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:30,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf7197af08e45fc2dd5 HTTP/1.1" 200 None 2026-05-08 01:23:30,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:30,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36eb197af08e45fc5af6 HTTP/1.1" 200 None 2026-05-08 01:23:30,911 - lava_callback - INFO - Completed processing callback for node 69fd36eb197af08e45fc5af6 INFO: 172.20.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:23:50,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:23:50,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45520 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:24:33,839 - lava_callback - INFO - Received callback for node 69fd36a2197af08e45fc59ef INFO: 172.20.0.1:37856 - "POST /node/69fd36a2197af08e45fc59ef HTTP/1.0" 202 Accepted 2026-05-08 01:24:33,848 - lava_callback - INFO - Starting async job submit for node 69fd36a2197af08e45fc59ef 2026-05-08 01:24:33,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:24:33,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a2197af08e45fc59ef HTTP/1.1" 200 None 2026-05-08 01:24:33,914 - lava_callback - DEBUG - Processing node 69fd36a2197af08e45fc59ef: baseline-nfs-arm64 2026-05-08 01:24:35,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:24:35,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:24:35,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a2197af08e45fc59ef/log.txt.gz 2026-05-08 01:24:35,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:24:36,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:24:36,063 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a2197af08e45fc59ef/lava-logs.yaml 2026-05-08 01:24:36,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:24:36,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:24:36,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd36a2197af08e45fc59ef/lava_callback.json.gz DEBUG: Setup failed for 69fd36a2197af08e45fc59ef. Transitting job node result: incomplete -> fail 2026-05-08 01:24:36,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:24:36,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36a2197af08e45fc59ef HTTP/1.1" 200 None 2026-05-08 01:24:36,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:37864 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:24:36,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:24:36,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:24:36,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36a2197af08e45fc59ef HTTP/1.1" 200 None 2026-05-08 01:24:36,651 - lava_callback - INFO - Completed processing callback for node 69fd36a2197af08e45fc59ef INFO: 172.20.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:24:50,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:24:50,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59982 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:25:14,143 - lava_callback - INFO - Received callback for node 69fd3738197af08e45fc5ba7 INFO: 172.20.0.1:39980 - "POST /node/69fd3738197af08e45fc5ba7 HTTP/1.0" 202 Accepted 2026-05-08 01:25:14,151 - lava_callback - INFO - Starting async job submit for node 69fd3738197af08e45fc5ba7 2026-05-08 01:25:14,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:25:14,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3738197af08e45fc5ba7 HTTP/1.1" 200 None 2026-05-08 01:25:14,227 - lava_callback - DEBUG - Processing node 69fd3738197af08e45fc5ba7: baseline-arm 2026-05-08 01:25:14,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:25:15,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:25:15,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3738197af08e45fc5ba7/log.txt.gz INFO: 172.20.0.1:39996 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 01:25:15,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:25:15,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:25:15,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3738197af08e45fc5ba7/lava-logs.yaml 2026-05-08 01:25:15,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:25:15,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:25:15,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd3738197af08e45fc5ba7/lava_callback.json.gz DEBUG: Setup failed for 69fd3738197af08e45fc5ba7. Transitting job node result: incomplete -> fail 2026-05-08 01:25:15,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:25:15,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3738197af08e45fc5ba7 HTTP/1.1" 200 None 2026-05-08 01:25:15,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:25:15,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 01:25:15,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:25:15,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3738197af08e45fc5ba7 HTTP/1.1" 200 None 2026-05-08 01:25:15,947 - lava_callback - INFO - Completed processing callback for node 69fd3738197af08e45fc5ba7 INFO: 172.20.0.1:40008 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:25:20,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:25:20,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36338 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:26:38,525 - lava_callback - INFO - Received callback for node 69fa98cae18d38d4eb0017f7 INFO: 172.20.0.1:36352 - "POST /node/69fa98cae18d38d4eb0017f7 HTTP/1.0" 202 Accepted 2026-05-08 01:26:38,531 - lava_callback - INFO - Starting async job submit for node 69fa98cae18d38d4eb0017f7 2026-05-08 01:26:38,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:26:38,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa98cae18d38d4eb0017f7 HTTP/1.1" 200 None 2026-05-08 01:26:38,547 - lava_callback - DEBUG - Processing node 69fa98cae18d38d4eb0017f7: baseline-arm64-clabbe 2026-05-08 01:26:38,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa98cae18d38d4eb0017f7 2026-05-08 01:26:38,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:26:38,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa98cae18d38d4eb0017f7 HTTP/1.1" 200 None 2026-05-08 01:26:38,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:26:38,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:26:38,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:26:38,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa98cae18d38d4eb0017f7 HTTP/1.1" 200 None 2026-05-08 01:26:38,606 - lava_callback - ERROR - Error processing callback for node 69fa98cae18d38d4eb0017f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52080 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:28:02,723 - lava_callback - INFO - Received callback for node 69fd3b4d197af08e45fc5e0d INFO: 172.20.0.1:48062 - "POST /node/69fd3b4d197af08e45fc5e0d HTTP/1.0" 202 Accepted 2026-05-08 01:28:02,729 - lava_callback - INFO - Starting async job submit for node 69fd3b4d197af08e45fc5e0d 2026-05-08 01:28:02,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:28:02,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3b4d197af08e45fc5e0d HTTP/1.1" 200 None 2026-05-08 01:28:02,765 - lava_callback - DEBUG - Processing node 69fd3b4d197af08e45fc5e0d: baseline-arm64 2026-05-08 01:28:03,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:28:03,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:28:03,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3b4d197af08e45fc5e0d/log.txt.gz 2026-05-08 01:28:03,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:28:03,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:28:03,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3b4d197af08e45fc5e0d/lava-logs.yaml 2026-05-08 01:28:03,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:28:03,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:28:03,635 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd3b4d197af08e45fc5e0d/lava_callback.json.gz 2026-05-08 01:28:03,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:28:03,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3b4d197af08e45fc5e0d HTTP/1.1" 200 None 2026-05-08 01:28:03,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:28:03,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:28:03,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:28:03,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3b4d197af08e45fc5e0d HTTP/1.1" 200 None 2026-05-08 01:28:03,803 - lava_callback - INFO - Completed processing callback for node 69fd3b4d197af08e45fc5e0d INFO: 172.20.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56222 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:28:20,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:28:20,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52566 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:29:18,684 - lava_callback - INFO - Received callback for node 69fa9967e18d38d4eb00184d INFO: 172.20.0.1:52580 - "POST /node/69fa9967e18d38d4eb00184d HTTP/1.0" 202 Accepted 2026-05-08 01:29:18,689 - lava_callback - INFO - Starting async job submit for node 69fa9967e18d38d4eb00184d 2026-05-08 01:29:18,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:18,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9967e18d38d4eb00184d HTTP/1.1" 200 None 2026-05-08 01:29:18,705 - lava_callback - DEBUG - Processing node 69fa9967e18d38d4eb00184d: baseline-arm64-clabbe 2026-05-08 01:29:18,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9967e18d38d4eb00184d 2026-05-08 01:29:18,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:18,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9967e18d38d4eb00184d HTTP/1.1" 200 None 2026-05-08 01:29:18,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:18,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:29:18,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:18,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9967e18d38d4eb00184d HTTP/1.1" 200 None 2026-05-08 01:29:18,765 - lava_callback - ERROR - Error processing callback for node 69fa9967e18d38d4eb00184d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34424 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:29:45,643 - lava_callback - INFO - Received callback for node 69fd37fd197af08e45fc5c32 INFO: 172.20.0.1:33362 - "POST /node/69fd37fd197af08e45fc5c32 HTTP/1.0" 202 Accepted 2026-05-08 01:29:45,694 - lava_callback - INFO - Starting async job submit for node 69fd37fd197af08e45fc5c32 2026-05-08 01:29:45,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:45,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd37fd197af08e45fc5c32 HTTP/1.1" 200 None 2026-05-08 01:29:45,745 - lava_callback - DEBUG - Processing node 69fd37fd197af08e45fc5c32: baseline-arm-pengutronix 2026-05-08 01:29:45,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:29:45,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:29:45,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd37fd197af08e45fc5c32/log.txt.gz 2026-05-08 01:29:46,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:29:46,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:29:46,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd37fd197af08e45fc5c32/lava-logs.yaml 2026-05-08 01:29:46,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:29:46,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:29:46,331 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd37fd197af08e45fc5c32/lava_callback.json.gz DEBUG: Setup failed for 69fd37fd197af08e45fc5c32. Transitting job node result: incomplete -> fail 2026-05-08 01:29:46,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:46,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd37fd197af08e45fc5c32 HTTP/1.1" 200 None 2026-05-08 01:29:46,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:46,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 01:29:46,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:46,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd37fd197af08e45fc5c32 HTTP/1.1" 200 None 2026-05-08 01:29:46,503 - lava_callback - INFO - Completed processing callback for node 69fd37fd197af08e45fc5c32 INFO: 172.20.0.1:33366 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:29:50,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:29:50,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49042 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:31:53,149 - lava_callback - INFO - Received callback for node 69fd36b7197af08e45fc5a47 INFO: 172.20.0.1:34868 - "POST /node/69fd36b7197af08e45fc5a47 HTTP/1.0" 202 Accepted 2026-05-08 01:31:53,156 - lava_callback - INFO - Starting async job submit for node 69fd36b7197af08e45fc5a47 2026-05-08 01:31:53,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:31:53,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b7197af08e45fc5a47 HTTP/1.1" 200 None 2026-05-08 01:31:53,206 - lava_callback - DEBUG - Processing node 69fd36b7197af08e45fc5a47: baseline-arm64-broonie 2026-05-08 01:31:53,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:31:53,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:31:53,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b7197af08e45fc5a47/log.txt.gz 2026-05-08 01:31:53,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:31:53,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:31:53,889 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b7197af08e45fc5a47/lava-logs.yaml 2026-05-08 01:31:53,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:34872 - "GET /node/69b12a0ba870a1dc3343bb6b%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-08 01:31:53,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:31:53,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b7197af08e45fc5a47/lava_callback.json.gz 2026-05-08 01:31:54,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:31:54,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b7197af08e45fc5a47 HTTP/1.1" 200 None 2026-05-08 01:31:54,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:31:54,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:31:54,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:31:54,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36b7197af08e45fc5a47 HTTP/1.1" 200 None 2026-05-08 01:31:54,083 - lava_callback - INFO - Completed processing callback for node 69fd36b7197af08e45fc5a47 INFO: 172.20.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:32:18,775 - lava_callback - INFO - Received callback for node 69fa9a0ce18d38d4eb001899 INFO: 172.20.0.1:40726 - "POST /node/69fa9a0ce18d38d4eb001899 HTTP/1.0" 202 Accepted 2026-05-08 01:32:18,781 - lava_callback - INFO - Starting async job submit for node 69fa9a0ce18d38d4eb001899 2026-05-08 01:32:18,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:32:18,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9a0ce18d38d4eb001899 HTTP/1.1" 200 None 2026-05-08 01:32:18,802 - lava_callback - DEBUG - Processing node 69fa9a0ce18d38d4eb001899: baseline-arm64-clabbe 2026-05-08 01:32:18,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9a0ce18d38d4eb001899 2026-05-08 01:32:18,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:32:18,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9a0ce18d38d4eb001899 HTTP/1.1" 200 None 2026-05-08 01:32:18,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:32:18,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:32:18,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:32:18,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9a0ce18d38d4eb001899 HTTP/1.1" 200 None 2026-05-08 01:32:18,848 - lava_callback - ERROR - Error processing callback for node 69fa9a0ce18d38d4eb001899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:32:20,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:32:20,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33930 - "GET /node/699434ef5ae459b9df3d3b48%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41724 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:34:53,454 - lava_callback - INFO - Received callback for node 69fd36be197af08e45fc5a53 INFO: 172.20.0.1:39428 - "POST /node/69fd36be197af08e45fc5a53 HTTP/1.0" 202 Accepted 2026-05-08 01:34:53,460 - lava_callback - INFO - Starting async job submit for node 69fd36be197af08e45fc5a53 2026-05-08 01:34:53,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:34:53,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36be197af08e45fc5a53 HTTP/1.1" 200 None 2026-05-08 01:34:53,497 - lava_callback - DEBUG - Processing node 69fd36be197af08e45fc5a53: baseline-arm64-broonie 2026-05-08 01:34:53,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:34:53,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:34:53,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36be197af08e45fc5a53/log.txt.gz 2026-05-08 01:34:54,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:34:54,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:34:54,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36be197af08e45fc5a53/lava-logs.yaml 2026-05-08 01:34:54,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:34:54,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:34:54,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36be197af08e45fc5a53/lava_callback.json.gz 2026-05-08 01:34:54,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:34:54,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36be197af08e45fc5a53 HTTP/1.1" 200 None 2026-05-08 01:34:54,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:34:54,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:34:54,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:34:54,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36be197af08e45fc5a53 HTTP/1.1" 200 None 2026-05-08 01:34:54,420 - lava_callback - INFO - Completed processing callback for node 69fd36be197af08e45fc5a53 INFO: 172.20.0.1:39440 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:34:58,832 - lava_callback - INFO - Received callback for node 69fa9aafe18d38d4eb0018d6 INFO: 172.20.0.1:39454 - "POST /node/69fa9aafe18d38d4eb0018d6 HTTP/1.0" 202 Accepted 2026-05-08 01:34:58,839 - lava_callback - INFO - Starting async job submit for node 69fa9aafe18d38d4eb0018d6 2026-05-08 01:34:58,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:34:58,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9aafe18d38d4eb0018d6 HTTP/1.1" 200 None 2026-05-08 01:34:58,852 - lava_callback - DEBUG - Processing node 69fa9aafe18d38d4eb0018d6: baseline-arm64-clabbe 2026-05-08 01:34:58,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9aafe18d38d4eb0018d6 2026-05-08 01:34:58,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:34:58,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9aafe18d38d4eb0018d6 HTTP/1.1" 200 None 2026-05-08 01:34:58,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:34:58,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 01:34:58,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:34:58,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9aafe18d38d4eb0018d6 HTTP/1.1" 200 None 2026-05-08 01:34:58,900 - lava_callback - ERROR - Error processing callback for node 69fa9aafe18d38d4eb0018d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44760 - "GET /node/693e1d39407f32424eb5726c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44768 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:35:20,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:35:20,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44044 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:37:22,778 - lava_callback - INFO - Received callback for node 69fa9b4ae18d38d4eb001925 INFO: 172.20.0.1:60250 - "POST /node/69fa9b4ae18d38d4eb001925 HTTP/1.0" 202 Accepted 2026-05-08 01:37:22,786 - lava_callback - INFO - Starting async job submit for node 69fa9b4ae18d38d4eb001925 2026-05-08 01:37:22,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:37:22,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9b4ae18d38d4eb001925 HTTP/1.1" 200 None 2026-05-08 01:37:22,801 - lava_callback - DEBUG - Processing node 69fa9b4ae18d38d4eb001925: baseline-arm64-baylibre 2026-05-08 01:37:22,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9b4ae18d38d4eb001925 2026-05-08 01:37:22,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:37:22,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9b4ae18d38d4eb001925 HTTP/1.1" 200 None 2026-05-08 01:37:22,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:37:22,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:37:22,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:37:22,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9b4ae18d38d4eb001925 HTTP/1.1" 200 None 2026-05-08 01:37:22,869 - lava_callback - ERROR - Error processing callback for node 69fa9b4ae18d38d4eb001925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:38:42,887 - lava_callback - INFO - Received callback for node 69fa9b99e18d38d4eb001947 INFO: 172.20.0.1:59516 - "POST /node/69fa9b99e18d38d4eb001947 HTTP/1.0" 202 Accepted 2026-05-08 01:38:42,892 - lava_callback - INFO - Starting async job submit for node 69fa9b99e18d38d4eb001947 2026-05-08 01:38:42,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:38:42,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9b99e18d38d4eb001947 HTTP/1.1" 200 None 2026-05-08 01:38:42,910 - lava_callback - DEBUG - Processing node 69fa9b99e18d38d4eb001947: baseline-arm64-baylibre 2026-05-08 01:38:42,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9b99e18d38d4eb001947 2026-05-08 01:38:42,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:38:42,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9b99e18d38d4eb001947 HTTP/1.1" 200 None 2026-05-08 01:38:42,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:38:42,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:38:42,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:38:42,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9b99e18d38d4eb001947 HTTP/1.1" 200 None 2026-05-08 01:38:42,978 - lava_callback - ERROR - Error processing callback for node 69fa9b99e18d38d4eb001947: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59232 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:40:03,197 - lava_callback - INFO - Received callback for node 69fa9bebe18d38d4eb001969 INFO: 172.20.0.1:57844 - "POST /node/69fa9bebe18d38d4eb001969 HTTP/1.0" 202 Accepted 2026-05-08 01:40:03,203 - lava_callback - INFO - Starting async job submit for node 69fa9bebe18d38d4eb001969 2026-05-08 01:40:03,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:40:03,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9bebe18d38d4eb001969 HTTP/1.1" 200 None 2026-05-08 01:40:03,218 - lava_callback - DEBUG - Processing node 69fa9bebe18d38d4eb001969: baseline-arm64-baylibre 2026-05-08 01:40:03,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9bebe18d38d4eb001969 2026-05-08 01:40:03,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:40:03,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9bebe18d38d4eb001969 HTTP/1.1" 200 None 2026-05-08 01:40:03,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:40:03,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:40:03,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:40:03,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9bebe18d38d4eb001969 HTTP/1.1" 200 None 2026-05-08 01:40:03,277 - lava_callback - ERROR - Error processing callback for node 69fa9bebe18d38d4eb001969: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40472 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:41:22,950 - lava_callback - INFO - Received callback for node 69fa9c3ce18d38d4eb00198b INFO: 172.20.0.1:42562 - "POST /node/69fa9c3ce18d38d4eb00198b HTTP/1.0" 202 Accepted 2026-05-08 01:41:22,955 - lava_callback - INFO - Starting async job submit for node 69fa9c3ce18d38d4eb00198b 2026-05-08 01:41:22,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:41:22,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9c3ce18d38d4eb00198b HTTP/1.1" 200 None 2026-05-08 01:41:22,970 - lava_callback - DEBUG - Processing node 69fa9c3ce18d38d4eb00198b: baseline-arm64-baylibre 2026-05-08 01:41:22,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9c3ce18d38d4eb00198b 2026-05-08 01:41:22,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:41:22,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9c3ce18d38d4eb00198b HTTP/1.1" 200 None 2026-05-08 01:41:22,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:41:23,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:41:23,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:41:23,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9c3ce18d38d4eb00198b HTTP/1.1" 200 None 2026-05-08 01:41:23,028 - lava_callback - ERROR - Error processing callback for node 69fa9c3ce18d38d4eb00198b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57588 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:42:42,998 - lava_callback - INFO - Received callback for node 69fa9c8ee18d38d4eb0019ac INFO: 172.20.0.1:43454 - "POST /node/69fa9c8ee18d38d4eb0019ac HTTP/1.0" 202 Accepted 2026-05-08 01:42:43,003 - lava_callback - INFO - Starting async job submit for node 69fa9c8ee18d38d4eb0019ac 2026-05-08 01:42:43,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:42:43,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9c8ee18d38d4eb0019ac HTTP/1.1" 200 None 2026-05-08 01:42:43,022 - lava_callback - DEBUG - Processing node 69fa9c8ee18d38d4eb0019ac: baseline-arm64-baylibre 2026-05-08 01:42:43,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9c8ee18d38d4eb0019ac 2026-05-08 01:42:43,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:42:43,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9c8ee18d38d4eb0019ac HTTP/1.1" 200 None 2026-05-08 01:42:43,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:42:43,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:42:43,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:42:43,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9c8ee18d38d4eb0019ac HTTP/1.1" 200 None 2026-05-08 01:42:43,068 - lava_callback - ERROR - Error processing callback for node 69fa9c8ee18d38d4eb0019ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:44:23,172 - lava_callback - INFO - Received callback for node 69fa9ce2e18d38d4eb0019d7 INFO: 172.20.0.1:37702 - "POST /node/69fa9ce2e18d38d4eb0019d7 HTTP/1.0" 202 Accepted 2026-05-08 01:44:23,178 - lava_callback - INFO - Starting async job submit for node 69fa9ce2e18d38d4eb0019d7 2026-05-08 01:44:23,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:44:23,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9ce2e18d38d4eb0019d7 HTTP/1.1" 200 None 2026-05-08 01:44:23,199 - lava_callback - DEBUG - Processing node 69fa9ce2e18d38d4eb0019d7: baseline-arm64-baylibre 2026-05-08 01:44:23,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9ce2e18d38d4eb0019d7 2026-05-08 01:44:23,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:44:23,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9ce2e18d38d4eb0019d7 HTTP/1.1" 200 None 2026-05-08 01:44:23,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:44:23,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:44:23,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:44:23,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9ce2e18d38d4eb0019d7 HTTP/1.1" 200 None 2026-05-08 01:44:23,246 - lava_callback - ERROR - Error processing callback for node 69fa9ce2e18d38d4eb0019d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44370 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:45:09,914 - lava_callback - INFO - Received callback for node 69fd36ba197af08e45fc5a4d INFO: 172.20.0.1:38646 - "POST /node/69fd36ba197af08e45fc5a4d HTTP/1.0" 202 Accepted 2026-05-08 01:45:09,920 - lava_callback - INFO - Starting async job submit for node 69fd36ba197af08e45fc5a4d 2026-05-08 01:45:09,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:09,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36ba197af08e45fc5a4d HTTP/1.1" 200 None 2026-05-08 01:45:09,957 - lava_callback - DEBUG - Processing node 69fd36ba197af08e45fc5a4d: baseline-arm64-broonie 2026-05-08 01:45:10,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:45:10,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:45:10,315 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36ba197af08e45fc5a4d/log.txt.gz 2026-05-08 01:45:10,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:45:10,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:45:10,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36ba197af08e45fc5a4d/lava-logs.yaml 2026-05-08 01:45:10,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:45:10,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:45:10,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36ba197af08e45fc5a4d/lava_callback.json.gz 2026-05-08 01:45:10,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:10,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36ba197af08e45fc5a4d HTTP/1.1" 200 None 2026-05-08 01:45:10,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:10,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:45:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:10,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36ba197af08e45fc5a4d HTTP/1.1" 200 None 2026-05-08 01:45:10,809 - lava_callback - INFO - Completed processing callback for node 69fd36ba197af08e45fc5a4d INFO: 172.20.0.1:38650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38656 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:45:20,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:20,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50230 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:45:39,360 - lava_callback - INFO - Received callback for node 69fa9d3de18d38d4eb0019f7 INFO: 172.20.0.1:50242 - "POST /node/69fa9d3de18d38d4eb0019f7 HTTP/1.0" 202 Accepted 2026-05-08 01:45:39,365 - lava_callback - INFO - Starting async job submit for node 69fa9d3de18d38d4eb0019f7 2026-05-08 01:45:39,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:39,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9d3de18d38d4eb0019f7 HTTP/1.1" 200 None 2026-05-08 01:45:39,381 - lava_callback - DEBUG - Processing node 69fa9d3de18d38d4eb0019f7: baseline-arm64-clabbe 2026-05-08 01:45:39,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9d3de18d38d4eb0019f7 2026-05-08 01:45:39,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:39,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9d3de18d38d4eb0019f7 HTTP/1.1" 200 None 2026-05-08 01:45:39,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:39,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:45:39,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:45:39,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9d3de18d38d4eb0019f7 HTTP/1.1" 200 None 2026-05-08 01:45:39,449 - lava_callback - ERROR - Error processing callback for node 69fa9d3de18d38d4eb0019f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51034 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:46:59,394 - lava_callback - INFO - Received callback for node 69fa9d8fe18d38d4eb001a1b INFO: 172.20.0.1:51048 - "POST /node/69fa9d8fe18d38d4eb001a1b HTTP/1.0" 202 Accepted 2026-05-08 01:46:59,401 - lava_callback - INFO - Starting async job submit for node 69fa9d8fe18d38d4eb001a1b 2026-05-08 01:46:59,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:46:59,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9d8fe18d38d4eb001a1b HTTP/1.1" 200 None 2026-05-08 01:46:59,417 - lava_callback - DEBUG - Processing node 69fa9d8fe18d38d4eb001a1b: baseline-arm64-clabbe 2026-05-08 01:46:59,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9d8fe18d38d4eb001a1b 2026-05-08 01:46:59,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:46:59,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9d8fe18d38d4eb001a1b HTTP/1.1" 200 None 2026-05-08 01:46:59,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:46:59,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:46:59,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:46:59,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9d8fe18d38d4eb001a1b HTTP/1.1" 200 None 2026-05-08 01:46:59,482 - lava_callback - ERROR - Error processing callback for node 69fa9d8fe18d38d4eb001a1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57794 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:47:50,222 - lava_callback - INFO - Received callback for node 69fd36b2197af08e45fc5a3a INFO: 172.20.0.1:44620 - "POST /node/69fd36b2197af08e45fc5a3a HTTP/1.0" 202 Accepted 2026-05-08 01:47:50,228 - lava_callback - INFO - Starting async job submit for node 69fd36b2197af08e45fc5a3a 2026-05-08 01:47:50,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:47:50,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b2197af08e45fc5a3a HTTP/1.1" 200 None 2026-05-08 01:47:50,266 - lava_callback - DEBUG - Processing node 69fd36b2197af08e45fc5a3a: baseline-arm64-broonie 2026-05-08 01:47:50,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:47:50,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:47:50,575 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b2197af08e45fc5a3a/log.txt.gz 2026-05-08 01:47:50,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:47:50,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:47:50,898 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b2197af08e45fc5a3a/lava-logs.yaml 2026-05-08 01:47:50,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:47:51,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:47:51,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b2197af08e45fc5a3a/lava_callback.json.gz 2026-05-08 01:47:51,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:47:51,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b2197af08e45fc5a3a HTTP/1.1" 200 None 2026-05-08 01:47:51,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:47:51,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:47:51,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:47:51,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36b2197af08e45fc5a3a HTTP/1.1" 200 None 2026-05-08 01:47:51,096 - lava_callback - INFO - Completed processing callback for node 69fd36b2197af08e45fc5a3a INFO: 172.20.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34206 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:48:20,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:20,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55140 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:48:34,022 - lava_callback - INFO - Received callback for node 69fd400e197af08e45fc6039 INFO: 172.20.0.1:38194 - "POST /node/69fd400e197af08e45fc6039 HTTP/1.0" 202 Accepted 2026-05-08 01:48:34,029 - lava_callback - INFO - Starting async job submit for node 69fd400e197af08e45fc6039 2026-05-08 01:48:34,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:34,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd400e197af08e45fc6039 HTTP/1.1" 200 None 2026-05-08 01:48:34,079 - lava_callback - DEBUG - Processing node 69fd400e197af08e45fc6039: ltp-pty 2026-05-08 01:48:34,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:48:34,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:48:34,603 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69fd400e197af08e45fc6039/log.txt.gz 2026-05-08 01:48:34,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:48:35,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:48:35,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69fd400e197af08e45fc6039/lava-logs.yaml 2026-05-08 01:48:35,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:48:35,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:48:35,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69fd400e197af08e45fc6039/lava_callback.json.gz 2026-05-08 01:48:35,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:35,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd400e197af08e45fc6039 HTTP/1.1" 200 None 2026-05-08 01:48:35,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:35,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 01:48:35,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:35,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd400e197af08e45fc6039 HTTP/1.1" 200 None 2026-05-08 01:48:35,334 - lava_callback - INFO - Completed processing callback for node 69fd400e197af08e45fc6039 INFO: 172.20.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38214 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:48:39,457 - lava_callback - INFO - Received callback for node 69fa9de9e18d38d4eb001a39 INFO: 172.20.0.1:38226 - "POST /node/69fa9de9e18d38d4eb001a39 HTTP/1.0" 202 Accepted 2026-05-08 01:48:39,465 - lava_callback - INFO - Starting async job submit for node 69fa9de9e18d38d4eb001a39 2026-05-08 01:48:39,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:39,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9de9e18d38d4eb001a39 HTTP/1.1" 200 None 2026-05-08 01:48:39,484 - lava_callback - DEBUG - Processing node 69fa9de9e18d38d4eb001a39: baseline-arm64-clabbe 2026-05-08 01:48:39,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9de9e18d38d4eb001a39 2026-05-08 01:48:39,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:39,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9de9e18d38d4eb001a39 HTTP/1.1" 200 None 2026-05-08 01:48:39,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:39,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:48:39,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:39,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9de9e18d38d4eb001a39 HTTP/1.1" 200 None 2026-05-08 01:48:39,542 - lava_callback - ERROR - Error processing callback for node 69fa9de9e18d38d4eb001a39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36186 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:48:50,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:48:50,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41606 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:49:59,416 - lava_callback - INFO - Received callback for node 69fa9e41e18d38d4eb001a5b INFO: 172.20.0.1:41618 - "POST /node/69fa9e41e18d38d4eb001a5b HTTP/1.0" 202 Accepted 2026-05-08 01:49:59,424 - lava_callback - INFO - Starting async job submit for node 69fa9e41e18d38d4eb001a5b 2026-05-08 01:49:59,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:49:59,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9e41e18d38d4eb001a5b HTTP/1.1" 200 None 2026-05-08 01:49:59,445 - lava_callback - DEBUG - Processing node 69fa9e41e18d38d4eb001a5b: baseline-arm64-clabbe 2026-05-08 01:49:59,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9e41e18d38d4eb001a5b 2026-05-08 01:49:59,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:49:59,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9e41e18d38d4eb001a5b HTTP/1.1" 200 None 2026-05-08 01:49:59,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:49:59,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:49:59,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:49:59,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9e41e18d38d4eb001a5b HTTP/1.1" 200 None 2026-05-08 01:49:59,500 - lava_callback - ERROR - Error processing callback for node 69fa9e41e18d38d4eb001a5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 01:50:02,801 - lava_callback - INFO - Received callback for node 69fd402a197af08e45fc6048 INFO: 172.20.0.1:35796 - "POST /node/69fd402a197af08e45fc6048 HTTP/1.0" 202 Accepted 2026-05-08 01:50:02,810 - lava_callback - INFO - Starting async job submit for node 69fd402a197af08e45fc6048 2026-05-08 01:50:02,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:50:02,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd402a197af08e45fc6048 HTTP/1.1" 200 None 2026-05-08 01:50:02,882 - lava_callback - DEBUG - Processing node 69fd402a197af08e45fc6048: baseline-arm64-foundriesio 2026-05-08 01:50:04,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:50:04,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:50:04,225 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd402a197af08e45fc6048/log.txt.gz 2026-05-08 01:50:04,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:50:05,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:50:05,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd402a197af08e45fc6048/lava-logs.yaml 2026-05-08 01:50:05,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:50:05,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:50:05,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd402a197af08e45fc6048/lava_callback.json.gz DEBUG: 69fd402a197af08e45fc6048 Transitting job node result: pass -> incomplete 2026-05-08 01:50:05,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:50:05,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd402a197af08e45fc6048 HTTP/1.1" 200 None 2026-05-08 01:50:05,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:50:05,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:50:05,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:50:05,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd402a197af08e45fc6048 HTTP/1.1" 200 None 2026-05-08 01:50:05,466 - lava_callback - INFO - Completed processing callback for node 69fd402a197af08e45fc6048 INFO: 172.20.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60728 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:50:20,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:50:20,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49048 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:51:19,489 - lava_callback - INFO - Received callback for node 69fa9e94e18d38d4eb001a72 INFO: 172.20.0.1:49050 - "POST /node/69fa9e94e18d38d4eb001a72 HTTP/1.0" 202 Accepted 2026-05-08 01:51:19,495 - lava_callback - INFO - Starting async job submit for node 69fa9e94e18d38d4eb001a72 2026-05-08 01:51:19,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:51:19,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9e94e18d38d4eb001a72 HTTP/1.1" 200 None 2026-05-08 01:51:19,511 - lava_callback - DEBUG - Processing node 69fa9e94e18d38d4eb001a72: baseline-arm64-clabbe 2026-05-08 01:51:19,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9e94e18d38d4eb001a72 2026-05-08 01:51:19,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:51:19,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9e94e18d38d4eb001a72 HTTP/1.1" 200 None 2026-05-08 01:51:19,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:51:19,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:51:19,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:51:19,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9e94e18d38d4eb001a72 HTTP/1.1" 200 None 2026-05-08 01:51:19,554 - lava_callback - ERROR - Error processing callback for node 69fa9e94e18d38d4eb001a72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52150 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:52:59,574 - lava_callback - INFO - Received callback for node 69fa9ee6e18d38d4eb001a93 INFO: 172.20.0.1:52158 - "POST /node/69fa9ee6e18d38d4eb001a93 HTTP/1.0" 202 Accepted 2026-05-08 01:52:59,580 - lava_callback - INFO - Starting async job submit for node 69fa9ee6e18d38d4eb001a93 2026-05-08 01:52:59,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:52:59,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9ee6e18d38d4eb001a93 HTTP/1.1" 200 None 2026-05-08 01:52:59,596 - lava_callback - DEBUG - Processing node 69fa9ee6e18d38d4eb001a93: baseline-arm64-clabbe 2026-05-08 01:52:59,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fa9ee6e18d38d4eb001a93 2026-05-08 01:52:59,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:52:59,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa9ee6e18d38d4eb001a93 HTTP/1.1" 200 None 2026-05-08 01:52:59,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:52:59,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 01:52:59,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:52:59,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa9ee6e18d38d4eb001a93 HTTP/1.1" 200 None 2026-05-08 01:52:59,644 - lava_callback - ERROR - Error processing callback for node 69fa9ee6e18d38d4eb001a93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60656 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:53:44,948 - lava_callback - INFO - Received callback for node 69fd4063197af08e45fc6067 INFO: 172.20.0.1:41208 - "POST /node/69fd4063197af08e45fc6067 HTTP/1.0" 202 Accepted 2026-05-08 01:53:44,955 - lava_callback - INFO - Starting async job submit for node 69fd4063197af08e45fc6067 2026-05-08 01:53:44,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:45,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4063197af08e45fc6067 HTTP/1.1" 200 None 2026-05-08 01:53:45,012 - lava_callback - DEBUG - Processing node 69fd4063197af08e45fc6067: baseline-arm64 2026-05-08 01:53:45,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:53:45,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:53:45,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4063197af08e45fc6067/log.txt.gz 2026-05-08 01:53:45,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:53:45,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:53:45,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4063197af08e45fc6067/lava-logs.yaml 2026-05-08 01:53:45,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:53:45,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:53:46,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4063197af08e45fc6067/lava_callback.json.gz DEBUG: Setup failed for 69fd4063197af08e45fc6067. Transitting job node result: incomplete -> fail 2026-05-08 01:53:46,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:46,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4063197af08e45fc6067 HTTP/1.1" 200 None 2026-05-08 01:53:46,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:46,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:53:46,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:46,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4063197af08e45fc6067 HTTP/1.1" 200 None 2026-05-08 01:53:46,242 - lava_callback - INFO - Completed processing callback for node 69fd4063197af08e45fc6067 INFO: 172.20.0.1:41218 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:53:50,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:50,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:53:58,612 - lava_callback - INFO - Received callback for node 69fd4227197af08e45fc6143 INFO: 172.20.0.1:54268 - "POST /node/69fd4227197af08e45fc6143 HTTP/1.0" 202 Accepted 2026-05-08 01:53:58,617 - lava_callback - INFO - Starting async job submit for node 69fd4227197af08e45fc6143 2026-05-08 01:53:58,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:58,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4227197af08e45fc6143 HTTP/1.1" 200 None 2026-05-08 01:53:58,634 - lava_callback - DEBUG - Processing node 69fd4227197af08e45fc6143: baseline-nfs-arm64 2026-05-08 01:53:58,635 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:53:58,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:53:58,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:53:58,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4227197af08e45fc6143/lava-logs.yaml 2026-05-08 01:53:58,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:53:58,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:53:58,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4227197af08e45fc6143/lava_callback.json.gz 2026-05-08 01:53:58,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:58,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4227197af08e45fc6143 HTTP/1.1" 200 None 2026-05-08 01:53:58,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:58,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:53:58,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:53:58,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4227197af08e45fc6143 HTTP/1.1" 200 None 2026-05-08 01:53:58,870 - lava_callback - INFO - Completed processing callback for node 69fd4227197af08e45fc6143 INFO: 172.20.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52218 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:54:20,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:54:20,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:54:54,495 - lava_callback - INFO - Received callback for node 69fd36b5197af08e45fc5a44 INFO: 172.20.0.1:59392 - "POST /node/69fd36b5197af08e45fc5a44 HTTP/1.0" 202 Accepted 2026-05-08 01:54:54,506 - lava_callback - INFO - Starting async job submit for node 69fd36b5197af08e45fc5a44 2026-05-08 01:54:54,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:54:54,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b5197af08e45fc5a44 HTTP/1.1" 200 None 2026-05-08 01:54:54,605 - lava_callback - DEBUG - Processing node 69fd36b5197af08e45fc5a44: baseline-arm64-broonie 2026-05-08 01:54:55,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:54:55,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:54:55,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b5197af08e45fc5a44/log.txt.gz 2026-05-08 01:54:56,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:54:56,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:54:56,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b5197af08e45fc5a44/lava-logs.yaml 2026-05-08 01:54:56,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:54:56,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:54:56,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd36b5197af08e45fc5a44/lava_callback.json.gz DEBUG: Setup failed for 69fd36b5197af08e45fc5a44. Transitting job node result: incomplete -> fail 2026-05-08 01:54:56,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:59406 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:54:56,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b5197af08e45fc5a44 HTTP/1.1" 200 None 2026-05-08 01:54:56,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:54:56,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:54:56,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:54:56,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36b5197af08e45fc5a44 HTTP/1.1" 200 None 2026-05-08 01:54:56,638 - lava_callback - INFO - Completed processing callback for node 69fd36b5197af08e45fc5a44 INFO: 172.20.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48130 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:55:20,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:55:20,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45920 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:57:08,259 - lava_callback - INFO - Received callback for node 69fd42b8197af08e45fc6190 INFO: 172.20.0.1:45928 - "POST /node/69fd42b8197af08e45fc6190 HTTP/1.0" 202 Accepted 2026-05-08 01:57:08,266 - lava_callback - INFO - Starting async job submit for node 69fd42b8197af08e45fc6190 2026-05-08 01:57:08,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:57:08,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd42b8197af08e45fc6190 HTTP/1.1" 200 None 2026-05-08 01:57:08,314 - lava_callback - DEBUG - Processing node 69fd42b8197af08e45fc6190: baseline-arm64 2026-05-08 01:57:08,490 - lava_callback - WARNING - Failed to upload log 2026-05-08 01:57:08,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:57:08,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:57:08,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd42b8197af08e45fc6190/lava-logs.yaml 2026-05-08 01:57:08,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:57:08,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:57:08,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd42b8197af08e45fc6190/lava_callback.json.gz 2026-05-08 01:57:08,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:57:08,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd42b8197af08e45fc6190 HTTP/1.1" 200 None 2026-05-08 01:57:08,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:57:08,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:57:08,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:57:08,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd42b8197af08e45fc6190 HTTP/1.1" 200 None 2026-05-08 01:57:09,048 - lava_callback - INFO - Completed processing callback for node 69fd42b8197af08e45fc6190 INFO: 172.20.0.1:41654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41658 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:57:20,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:57:20,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46956 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:59:36,504 - lava_callback - INFO - Received callback for node 69fd4352197af08e45fc61ce INFO: 172.20.0.1:46574 - "POST /node/69fd4352197af08e45fc61ce HTTP/1.0" 202 Accepted 2026-05-08 01:59:36,511 - lava_callback - INFO - Starting async job submit for node 69fd4352197af08e45fc61ce 2026-05-08 01:59:36,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:59:36,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4352197af08e45fc61ce HTTP/1.1" 200 None 2026-05-08 01:59:36,546 - lava_callback - DEBUG - Processing node 69fd4352197af08e45fc61ce: baseline-arm64 INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:59:36,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:59:37,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:59:37,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4352197af08e45fc61ce/log.txt.gz INFO: 172.20.0.1:46592 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:59:37,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:59:37,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:59:37,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4352197af08e45fc61ce/lava-logs.yaml 2026-05-08 01:59:37,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 01:59:37,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 01:59:37,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4352197af08e45fc61ce/lava_callback.json.gz 2026-05-08 01:59:37,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:59:37,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4352197af08e45fc61ce HTTP/1.1" 200 None 2026-05-08 01:59:37,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:59:37,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 01:59:37,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:59:37,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4352197af08e45fc61ce HTTP/1.1" 200 None 2026-05-08 01:59:37,761 - lava_callback - INFO - Completed processing callback for node 69fd4352197af08e45fc61ce INFO: 172.20.0.1:33824 - "GET / HTTP/1.0" 200 OK 2026-05-08 01:59:50,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 01:59:50,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45248 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:00:38,000 - lava_callback - INFO - Received callback for node 69fd4144197af08e45fc60d6 INFO: 172.20.0.1:45250 - "POST /node/69fd4144197af08e45fc60d6 HTTP/1.0" 202 Accepted 2026-05-08 02:00:38,007 - lava_callback - INFO - Starting async job submit for node 69fd4144197af08e45fc60d6 2026-05-08 02:00:38,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:00:38,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4144197af08e45fc60d6 HTTP/1.1" 200 None 2026-05-08 02:00:38,070 - lava_callback - DEBUG - Processing node 69fd4144197af08e45fc60d6: baseline-arm64 2026-05-08 02:00:38,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:00:38,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:00:38,789 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4144197af08e45fc60d6/log.txt.gz 2026-05-08 02:00:39,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:00:39,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:00:39,263 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4144197af08e45fc60d6/lava-logs.yaml 2026-05-08 02:00:39,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:00:39,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:00:39,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4144197af08e45fc60d6/lava_callback.json.gz 2026-05-08 02:00:39,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:00:39,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4144197af08e45fc60d6 HTTP/1.1" 200 None 2026-05-08 02:00:39,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:00:39,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:00:39,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:00:39,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4144197af08e45fc60d6 HTTP/1.1" 200 None 2026-05-08 02:00:39,541 - lava_callback - INFO - Completed processing callback for node 69fd4144197af08e45fc60d6 INFO: 172.20.0.1:44500 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:00:50,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:00:50,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57424 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:03:35,220 - lava_callback - INFO - Received callback for node 69fd41de197af08e45fc6120 INFO: 172.20.0.1:56994 - "POST /node/69fd41de197af08e45fc6120 HTTP/1.0" 202 Accepted 2026-05-08 02:03:35,227 - lava_callback - INFO - Starting async job submit for node 69fd41de197af08e45fc6120 2026-05-08 02:03:35,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:35,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd41de197af08e45fc6120 HTTP/1.1" 200 None 2026-05-08 02:03:35,285 - lava_callback - DEBUG - Processing node 69fd41de197af08e45fc6120: baseline-nfs-arm64 2026-05-08 02:03:35,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:03:36,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:03:36,014 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd41de197af08e45fc6120/log.txt.gz 2026-05-08 02:03:36,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:03:36,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:03:36,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd41de197af08e45fc6120/lava-logs.yaml 2026-05-08 02:03:36,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57004 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:03:36,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:03:36,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd41de197af08e45fc6120/lava_callback.json.gz 2026-05-08 02:03:36,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:36,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd41de197af08e45fc6120 HTTP/1.1" 200 None 2026-05-08 02:03:36,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:36,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:03:36,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:36,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd41de197af08e45fc6120 HTTP/1.1" 200 None 2026-05-08 02:03:36,681 - lava_callback - INFO - Completed processing callback for node 69fd41de197af08e45fc6120 INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:03:40,031 - lava_callback - INFO - Received callback for node 69fd443c197af08e45fc622e INFO: 172.20.0.1:59016 - "POST /node/69fd443c197af08e45fc622e HTTP/1.0" 202 Accepted 2026-05-08 02:03:40,038 - lava_callback - INFO - Starting async job submit for node 69fd443c197af08e45fc622e 2026-05-08 02:03:40,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:40,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd443c197af08e45fc622e HTTP/1.1" 200 None 2026-05-08 02:03:40,091 - lava_callback - DEBUG - Processing node 69fd443c197af08e45fc622e: baseline-arm64 2026-05-08 02:03:40,261 - lava_callback - WARNING - Failed to upload log 2026-05-08 02:03:40,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:03:40,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:03:40,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd443c197af08e45fc622e/lava-logs.yaml 2026-05-08 02:03:40,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:03:40,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:03:40,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd443c197af08e45fc622e/lava_callback.json.gz 2026-05-08 02:03:40,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:40,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd443c197af08e45fc622e HTTP/1.1" 200 None 2026-05-08 02:03:40,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:40,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:03:40,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:40,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd443c197af08e45fc622e HTTP/1.1" 200 None 2026-05-08 02:03:40,672 - lava_callback - INFO - Completed processing callback for node 69fd443c197af08e45fc622e INFO: 172.20.0.1:59026 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:03:50,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:03:50,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36900 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:07:44,383 - lava_callback - INFO - Received callback for node 69faa25ee18d38d4eb001be0 INFO: 172.20.0.1:45996 - "POST /node/69faa25ee18d38d4eb001be0 HTTP/1.0" 202 Accepted 2026-05-08 02:07:44,388 - lava_callback - INFO - Starting async job submit for node 69faa25ee18d38d4eb001be0 2026-05-08 02:07:44,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:07:44,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa25ee18d38d4eb001be0 HTTP/1.1" 200 None 2026-05-08 02:07:44,404 - lava_callback - DEBUG - Processing node 69faa25ee18d38d4eb001be0: baseline-arm64-baylibre 2026-05-08 02:07:44,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa25ee18d38d4eb001be0 2026-05-08 02:07:44,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:07:44,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa25ee18d38d4eb001be0 HTTP/1.1" 200 None 2026-05-08 02:07:44,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:07:44,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-08 02:07:44,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:07:44,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa25ee18d38d4eb001be0 HTTP/1.1" 200 None 2026-05-08 02:07:44,457 - lava_callback - ERROR - Error processing callback for node 69faa25ee18d38d4eb001be0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47138 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:09:00,368 - lava_callback - INFO - Received callback for node 69faa2b9e18d38d4eb001c0f INFO: 172.20.0.1:53018 - "POST /node/69faa2b9e18d38d4eb001c0f HTTP/1.0" 202 Accepted 2026-05-08 02:09:00,374 - lava_callback - INFO - Starting async job submit for node 69faa2b9e18d38d4eb001c0f 2026-05-08 02:09:00,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:09:00,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa2b9e18d38d4eb001c0f HTTP/1.1" 200 None 2026-05-08 02:09:00,389 - lava_callback - DEBUG - Processing node 69faa2b9e18d38d4eb001c0f: baseline-arm64-clabbe 2026-05-08 02:09:00,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa2b9e18d38d4eb001c0f 2026-05-08 02:09:00,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:09:00,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa2b9e18d38d4eb001c0f HTTP/1.1" 200 None 2026-05-08 02:09:00,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:09:00,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-08 02:09:00,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:09:00,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa2b9e18d38d4eb001c0f HTTP/1.1" 200 None 2026-05-08 02:09:00,458 - lava_callback - ERROR - Error processing callback for node 69faa2b9e18d38d4eb001c0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39830 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:10:43,944 - lava_callback - INFO - Received callback for node 69fd455c197af08e45fc62a4 INFO: 172.20.0.1:45162 - "POST /node/69fd455c197af08e45fc62a4 HTTP/1.0" 202 Accepted 2026-05-08 02:10:43,951 - lava_callback - INFO - Starting async job submit for node 69fd455c197af08e45fc62a4 2026-05-08 02:10:43,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:10:43,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd455c197af08e45fc62a4 HTTP/1.1" 200 None 2026-05-08 02:10:43,985 - lava_callback - DEBUG - Processing node 69fd455c197af08e45fc62a4: baseline-arm64 2026-05-08 02:10:44,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:10:44,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:10:44,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd455c197af08e45fc62a4/log.txt.gz 2026-05-08 02:10:44,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:10:44,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:10:44,836 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd455c197af08e45fc62a4/lava-logs.yaml 2026-05-08 02:10:44,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:10:44,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:10:44,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd455c197af08e45fc62a4/lava_callback.json.gz 2026-05-08 02:10:45,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:10:45,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd455c197af08e45fc62a4 HTTP/1.1" 200 None 2026-05-08 02:10:45,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:10:45,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:10:45,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:10:45,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd455c197af08e45fc62a4 HTTP/1.1" 200 None 2026-05-08 02:10:45,176 - lava_callback - INFO - Completed processing callback for node 69fd455c197af08e45fc62a4 INFO: 172.20.0.1:45174 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:10:50,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:10:50,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34442 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:12:00,402 - lava_callback - INFO - Received callback for node 69faa365e18d38d4eb001c4f INFO: 172.20.0.1:58760 - "POST /node/69faa365e18d38d4eb001c4f HTTP/1.0" 202 Accepted 2026-05-08 02:12:00,407 - lava_callback - INFO - Starting async job submit for node 69faa365e18d38d4eb001c4f 2026-05-08 02:12:00,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:12:00,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa365e18d38d4eb001c4f HTTP/1.1" 200 None 2026-05-08 02:12:00,435 - lava_callback - DEBUG - Processing node 69faa365e18d38d4eb001c4f: baseline-arm64-clabbe 2026-05-08 02:12:00,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa365e18d38d4eb001c4f 2026-05-08 02:12:00,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:12:00,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa365e18d38d4eb001c4f HTTP/1.1" 200 None 2026-05-08 02:12:00,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:12:00,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-08 02:12:00,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:12:00,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa365e18d38d4eb001c4f HTTP/1.1" 200 None 2026-05-08 02:12:00,483 - lava_callback - ERROR - Error processing callback for node 69faa365e18d38d4eb001c4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48850 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:13:20,512 - lava_callback - INFO - Received callback for node 69faa3b8e18d38d4eb001c77 INFO: 172.20.0.1:57856 - "POST /node/69faa3b8e18d38d4eb001c77 HTTP/1.0" 202 Accepted 2026-05-08 02:13:20,517 - lava_callback - INFO - Starting async job submit for node 69faa3b8e18d38d4eb001c77 2026-05-08 02:13:20,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:13:20,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa3b8e18d38d4eb001c77 HTTP/1.1" 200 None 2026-05-08 02:13:20,534 - lava_callback - DEBUG - Processing node 69faa3b8e18d38d4eb001c77: baseline-arm64-clabbe 2026-05-08 02:13:20,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa3b8e18d38d4eb001c77 2026-05-08 02:13:20,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:13:20,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa3b8e18d38d4eb001c77 HTTP/1.1" 200 None 2026-05-08 02:13:20,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:13:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-08 02:13:20,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:13:20,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa3b8e18d38d4eb001c77 HTTP/1.1" 200 None 2026-05-08 02:13:20,578 - lava_callback - ERROR - Error processing callback for node 69faa3b8e18d38d4eb001c77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:14:40,559 - lava_callback - INFO - Received callback for node 69faa40be18d38d4eb001c9e INFO: 172.20.0.1:37712 - "POST /node/69faa40be18d38d4eb001c9e HTTP/1.0" 202 Accepted 2026-05-08 02:14:40,564 - lava_callback - INFO - Starting async job submit for node 69faa40be18d38d4eb001c9e 2026-05-08 02:14:40,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:14:40,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa40be18d38d4eb001c9e HTTP/1.1" 200 None 2026-05-08 02:14:40,579 - lava_callback - DEBUG - Processing node 69faa40be18d38d4eb001c9e: baseline-arm64-clabbe 2026-05-08 02:14:40,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa40be18d38d4eb001c9e 2026-05-08 02:14:40,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:14:40,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa40be18d38d4eb001c9e HTTP/1.1" 200 None 2026-05-08 02:14:40,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:14:40,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-08 02:14:40,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:14:40,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa40be18d38d4eb001c9e HTTP/1.1" 200 None 2026-05-08 02:14:40,635 - lava_callback - ERROR - Error processing callback for node 69faa40be18d38d4eb001c9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54834 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:16:20,637 - lava_callback - INFO - Received callback for node 69faa45fe18d38d4eb001cc7 INFO: 172.20.0.1:43348 - "POST /node/69faa45fe18d38d4eb001cc7 HTTP/1.0" 202 Accepted 2026-05-08 02:16:20,643 - lava_callback - INFO - Starting async job submit for node 69faa45fe18d38d4eb001cc7 2026-05-08 02:16:20,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:16:20,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa45fe18d38d4eb001cc7 HTTP/1.1" 200 None 2026-05-08 02:16:20,673 - lava_callback - DEBUG - Processing node 69faa45fe18d38d4eb001cc7: baseline-arm64-clabbe 2026-05-08 02:16:20,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa45fe18d38d4eb001cc7 2026-05-08 02:16:20,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:16:20,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa45fe18d38d4eb001cc7 HTTP/1.1" 200 None 2026-05-08 02:16:20,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:16:20,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-08 02:16:20,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:16:20,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa45fe18d38d4eb001cc7 HTTP/1.1" 200 None 2026-05-08 02:16:20,725 - lava_callback - ERROR - Error processing callback for node 69faa45fe18d38d4eb001cc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35284 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:19:00,643 - lava_callback - INFO - Received callback for node 69faa502e18d38d4eb001d09 INFO: 172.20.0.1:44622 - "POST /node/69faa502e18d38d4eb001d09 HTTP/1.0" 202 Accepted 2026-05-08 02:19:00,651 - lava_callback - INFO - Starting async job submit for node 69faa502e18d38d4eb001d09 2026-05-08 02:19:00,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:19:00,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa502e18d38d4eb001d09 HTTP/1.1" 200 None 2026-05-08 02:19:00,672 - lava_callback - DEBUG - Processing node 69faa502e18d38d4eb001d09: baseline-arm64-clabbe 2026-05-08 02:19:00,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa502e18d38d4eb001d09 2026-05-08 02:19:00,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:19:00,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa502e18d38d4eb001d09 HTTP/1.1" 200 None 2026-05-08 02:19:00,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:19:00,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fd4e2fa3d7693ba43c1 HTTP/1.1" 200 None 2026-05-08 02:19:00,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:19:00,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa502e18d38d4eb001d09 HTTP/1.1" 200 None 2026-05-08 02:19:00,718 - lava_callback - ERROR - Error processing callback for node 69faa502e18d38d4eb001d09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55392 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:20:05,071 - lava_callback - INFO - Received callback for node 69faa541e18d38d4eb001d24 INFO: 172.20.0.1:38602 - "POST /node/69faa541e18d38d4eb001d24 HTTP/1.0" 202 Accepted 2026-05-08 02:20:05,079 - lava_callback - INFO - Starting async job submit for node 69faa541e18d38d4eb001d24 2026-05-08 02:20:05,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:20:05,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa541e18d38d4eb001d24 HTTP/1.1" 200 None 2026-05-08 02:20:05,094 - lava_callback - DEBUG - Processing node 69faa541e18d38d4eb001d24: baseline-arm-baylibre 2026-05-08 02:20:05,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa541e18d38d4eb001d24 2026-05-08 02:20:05,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:20:05,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa541e18d38d4eb001d24 HTTP/1.1" 200 None 2026-05-08 02:20:05,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:20:05,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:20:05,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:20:05,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa541e18d38d4eb001d24 HTTP/1.1" 200 None 2026-05-08 02:20:05,147 - lava_callback - ERROR - Error processing callback for node 69faa541e18d38d4eb001d24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38508 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:20:24,997 - lava_callback - INFO - Received callback for node 69faa566e18d38d4eb001d32 INFO: 172.20.0.1:59226 - "POST /node/69faa566e18d38d4eb001d32 HTTP/1.0" 202 Accepted 2026-05-08 02:20:25,003 - lava_callback - INFO - Starting async job submit for node 69faa566e18d38d4eb001d32 2026-05-08 02:20:25,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:20:25,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa566e18d38d4eb001d32 HTTP/1.1" 200 None 2026-05-08 02:20:25,018 - lava_callback - DEBUG - Processing node 69faa566e18d38d4eb001d32: baseline-arm-baylibre 2026-05-08 02:20:25,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa566e18d38d4eb001d32 2026-05-08 02:20:25,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:20:25,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa566e18d38d4eb001d32 HTTP/1.1" 200 None 2026-05-08 02:20:25,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:20:25,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:20:25,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:20:25,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa566e18d38d4eb001d32 HTTP/1.1" 200 None 2026-05-08 02:20:25,078 - lava_callback - ERROR - Error processing callback for node 69faa566e18d38d4eb001d32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55250 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:21:05,044 - lava_callback - INFO - Received callback for node 69faa58ce18d38d4eb001d3a INFO: 172.20.0.1:47640 - "POST /node/69faa58ce18d38d4eb001d3a HTTP/1.0" 202 Accepted 2026-05-08 02:21:05,051 - lava_callback - INFO - Starting async job submit for node 69faa58ce18d38d4eb001d3a 2026-05-08 02:21:05,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:05,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa58ce18d38d4eb001d3a HTTP/1.1" 200 None 2026-05-08 02:21:05,075 - lava_callback - DEBUG - Processing node 69faa58ce18d38d4eb001d3a: baseline-arm-baylibre 2026-05-08 02:21:05,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa58ce18d38d4eb001d3a 2026-05-08 02:21:05,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:05,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa58ce18d38d4eb001d3a HTTP/1.1" 200 None 2026-05-08 02:21:05,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:05,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:21:05,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:05,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa58ce18d38d4eb001d3a HTTP/1.1" 200 None 2026-05-08 02:21:05,136 - lava_callback - ERROR - Error processing callback for node 69faa58ce18d38d4eb001d3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36394 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:21:37,587 - lava_callback - INFO - Received callback for node 69fd44df197af08e45fc6277 INFO: 172.20.0.1:36406 - "POST /node/69fd44df197af08e45fc6277 HTTP/1.0" 202 Accepted 2026-05-08 02:21:37,593 - lava_callback - INFO - Starting async job submit for node 69fd44df197af08e45fc6277 2026-05-08 02:21:37,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:37,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd44df197af08e45fc6277 HTTP/1.1" 200 None 2026-05-08 02:21:37,704 - lava_callback - DEBUG - Processing node 69fd44df197af08e45fc6277: baseline-arm 2026-05-08 02:21:38,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:21:38,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:21:38,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd44df197af08e45fc6277/log.txt.gz 2026-05-08 02:21:38,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:21:39,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:21:39,020 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd44df197af08e45fc6277/lava-logs.yaml 2026-05-08 02:21:39,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:21:39,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:21:39,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd44df197af08e45fc6277/lava_callback.json.gz DEBUG: Setup failed for 69fd44df197af08e45fc6277. Transitting job node result: incomplete -> fail 2026-05-08 02:21:39,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:39,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd44df197af08e45fc6277 HTTP/1.1" 200 None 2026-05-08 02:21:39,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:39,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 02:21:39,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:39,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd44df197af08e45fc6277 HTTP/1.1" 200 None 2026-05-08 02:21:39,427 - lava_callback - INFO - Completed processing callback for node 69fd44df197af08e45fc6277 INFO: 172.20.0.1:42300 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:21:50,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:50,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 02:21:51,677 - lava_callback - INFO - Received callback for node 69fd448d197af08e45fc6254 INFO: 172.20.0.1:46678 - "POST /node/69fd448d197af08e45fc6254 HTTP/1.0" 202 Accepted 2026-05-08 02:21:51,684 - lava_callback - INFO - Starting async job submit for node 69fd448d197af08e45fc6254 2026-05-08 02:21:51,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:51,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd448d197af08e45fc6254 HTTP/1.1" 200 None 2026-05-08 02:21:51,784 - lava_callback - DEBUG - Processing node 69fd448d197af08e45fc6254: ltp-smoke 2026-05-08 02:21:52,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:21:52,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:21:52,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd448d197af08e45fc6254/log.txt.gz 2026-05-08 02:21:52,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:21:52,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:21:52,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd448d197af08e45fc6254/lava-logs.yaml 2026-05-08 02:21:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:21:52,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:21:52,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd448d197af08e45fc6254/lava_callback.json.gz 2026-05-08 02:21:53,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:53,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd448d197af08e45fc6254 HTTP/1.1" 200 None 2026-05-08 02:21:53,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:53,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf7197af08e45fc2dd5 HTTP/1.1" 200 None 2026-05-08 02:21:53,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:21:53,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd448d197af08e45fc6254 HTTP/1.1" 200 None 2026-05-08 02:21:53,259 - lava_callback - INFO - Completed processing callback for node 69fd448d197af08e45fc6254 INFO: 172.20.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33146 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:22:20,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:22:20,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59678 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:23:05,287 - lava_callback - INFO - Received callback for node 69faa5ffe18d38d4eb001d63 INFO: 172.20.0.1:40094 - "POST /node/69faa5ffe18d38d4eb001d63 HTTP/1.0" 202 Accepted 2026-05-08 02:23:05,295 - lava_callback - INFO - Starting async job submit for node 69faa5ffe18d38d4eb001d63 2026-05-08 02:23:05,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:23:05,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa5ffe18d38d4eb001d63 HTTP/1.1" 200 None 2026-05-08 02:23:05,313 - lava_callback - DEBUG - Processing node 69faa5ffe18d38d4eb001d63: baseline-arm-baylibre 2026-05-08 02:23:05,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa5ffe18d38d4eb001d63 2026-05-08 02:23:05,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:23:05,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa5ffe18d38d4eb001d63 HTTP/1.1" 200 None 2026-05-08 02:23:05,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:23:05,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:23:05,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:23:05,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa5ffe18d38d4eb001d63 HTTP/1.1" 200 None 2026-05-08 02:23:05,358 - lava_callback - ERROR - Error processing callback for node 69faa5ffe18d38d4eb001d63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52094 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:23:45,191 - lava_callback - INFO - Received callback for node 69faa624e18d38d4eb001d6c INFO: 172.20.0.1:37550 - "POST /node/69faa624e18d38d4eb001d6c HTTP/1.0" 202 Accepted 2026-05-08 02:23:45,197 - lava_callback - INFO - Starting async job submit for node 69faa624e18d38d4eb001d6c 2026-05-08 02:23:45,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:23:45,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa624e18d38d4eb001d6c HTTP/1.1" 200 None 2026-05-08 02:23:45,212 - lava_callback - DEBUG - Processing node 69faa624e18d38d4eb001d6c: baseline-arm-baylibre 2026-05-08 02:23:45,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa624e18d38d4eb001d6c 2026-05-08 02:23:45,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:23:45,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa624e18d38d4eb001d6c HTTP/1.1" 200 None 2026-05-08 02:23:45,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:23:45,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:23:45,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:23:45,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa624e18d38d4eb001d6c HTTP/1.1" 200 None 2026-05-08 02:23:45,260 - lava_callback - ERROR - Error processing callback for node 69faa624e18d38d4eb001d6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:24:01,448 - lava_callback - INFO - Received callback for node 69fd4496197af08e45fc6257 INFO: 172.20.0.1:58570 - "POST /node/69fd4496197af08e45fc6257 HTTP/1.0" 202 Accepted 2026-05-08 02:24:01,456 - lava_callback - INFO - Starting async job submit for node 69fd4496197af08e45fc6257 2026-05-08 02:24:01,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:24:01,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4496197af08e45fc6257 HTTP/1.1" 200 None 2026-05-08 02:24:01,530 - lava_callback - DEBUG - Processing node 69fd4496197af08e45fc6257: baseline-nfs-arm64 2026-05-08 02:24:02,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:24:02,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:24:02,757 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4496197af08e45fc6257/log.txt.gz 2026-05-08 02:24:03,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:24:03,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:24:03,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4496197af08e45fc6257/lava-logs.yaml 2026-05-08 02:24:03,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:24:03,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:24:03,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4496197af08e45fc6257/lava_callback.json.gz DEBUG: Setup failed for 69fd4496197af08e45fc6257. Transitting job node result: incomplete -> fail 2026-05-08 02:24:04,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:24:04,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4496197af08e45fc6257 HTTP/1.1" 200 None 2026-05-08 02:24:04,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:24:04,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:24:04,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:24:04,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4496197af08e45fc6257 HTTP/1.1" 200 None 2026-05-08 02:24:04,204 - lava_callback - INFO - Completed processing callback for node 69fd4496197af08e45fc6257 INFO: 172.20.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53946 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:24:20,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:24:20,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:26:05,493 - lava_callback - INFO - Received callback for node 69faa6b3e18d38d4eb001d99 INFO: 172.20.0.1:41224 - "POST /node/69faa6b3e18d38d4eb001d99 HTTP/1.0" 202 Accepted 2026-05-08 02:26:05,498 - lava_callback - INFO - Starting async job submit for node 69faa6b3e18d38d4eb001d99 2026-05-08 02:26:05,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:26:05,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa6b3e18d38d4eb001d99 HTTP/1.1" 200 None 2026-05-08 02:26:05,513 - lava_callback - DEBUG - Processing node 69faa6b3e18d38d4eb001d99: baseline-arm-baylibre 2026-05-08 02:26:05,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa6b3e18d38d4eb001d99 2026-05-08 02:26:05,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:26:05,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa6b3e18d38d4eb001d99 HTTP/1.1" 200 None 2026-05-08 02:26:05,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:26:05,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:26:05,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:26:05,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa6b3e18d38d4eb001d99 HTTP/1.1" 200 None 2026-05-08 02:26:05,563 - lava_callback - ERROR - Error processing callback for node 69faa6b3e18d38d4eb001d99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:26:41,033 - lava_callback - INFO - Received callback for node 69faa6d9e18d38d4eb001da1 INFO: 172.20.0.1:59920 - "POST /node/69faa6d9e18d38d4eb001da1 HTTP/1.0" 202 Accepted 2026-05-08 02:26:41,038 - lava_callback - INFO - Starting async job submit for node 69faa6d9e18d38d4eb001da1 2026-05-08 02:26:41,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:26:41,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa6d9e18d38d4eb001da1 HTTP/1.1" 200 None 2026-05-08 02:26:41,053 - lava_callback - DEBUG - Processing node 69faa6d9e18d38d4eb001da1: baseline-arm-clabbe 2026-05-08 02:26:41,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa6d9e18d38d4eb001da1 2026-05-08 02:26:41,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:26:41,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa6d9e18d38d4eb001da1 HTTP/1.1" 200 None 2026-05-08 02:26:41,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:26:41,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:26:41,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:26:41,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa6d9e18d38d4eb001da1 HTTP/1.1" 200 None 2026-05-08 02:26:41,098 - lava_callback - ERROR - Error processing callback for node 69faa6d9e18d38d4eb001da1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47380 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:28:01,086 - lava_callback - INFO - Received callback for node 69faa722e18d38d4eb001dc2 INFO: 172.20.0.1:44518 - "POST /node/69faa722e18d38d4eb001dc2 HTTP/1.0" 202 Accepted 2026-05-08 02:28:01,095 - lava_callback - INFO - Starting async job submit for node 69faa722e18d38d4eb001dc2 2026-05-08 02:28:01,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:28:01,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa722e18d38d4eb001dc2 HTTP/1.1" 200 None 2026-05-08 02:28:01,116 - lava_callback - DEBUG - Processing node 69faa722e18d38d4eb001dc2: baseline-arm-clabbe 2026-05-08 02:28:01,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa722e18d38d4eb001dc2 2026-05-08 02:28:01,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:28:01,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa722e18d38d4eb001dc2 HTTP/1.1" 200 None 2026-05-08 02:28:01,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:28:01,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:28:01,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:28:01,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa722e18d38d4eb001dc2 HTTP/1.1" 200 None 2026-05-08 02:28:01,163 - lava_callback - ERROR - Error processing callback for node 69faa722e18d38d4eb001dc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39924 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:28:41,149 - lava_callback - INFO - Received callback for node 69faa749e18d38d4eb001dce INFO: 172.20.0.1:47070 - "POST /node/69faa749e18d38d4eb001dce HTTP/1.0" 202 Accepted 2026-05-08 02:28:41,155 - lava_callback - INFO - Starting async job submit for node 69faa749e18d38d4eb001dce 2026-05-08 02:28:41,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:28:41,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa749e18d38d4eb001dce HTTP/1.1" 200 None 2026-05-08 02:28:41,170 - lava_callback - DEBUG - Processing node 69faa749e18d38d4eb001dce: baseline-arm-clabbe 2026-05-08 02:28:41,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa749e18d38d4eb001dce 2026-05-08 02:28:41,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:28:41,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa749e18d38d4eb001dce HTTP/1.1" 200 None 2026-05-08 02:28:41,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:28:41,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:28:41,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:28:41,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa749e18d38d4eb001dce HTTP/1.1" 200 None 2026-05-08 02:28:41,216 - lava_callback - ERROR - Error processing callback for node 69faa749e18d38d4eb001dce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33042 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:29:21,315 - lava_callback - INFO - Received callback for node 69faa76ee18d38d4eb001dd6 INFO: 172.20.0.1:41670 - "POST /node/69faa76ee18d38d4eb001dd6 HTTP/1.0" 202 Accepted 2026-05-08 02:29:21,321 - lava_callback - INFO - Starting async job submit for node 69faa76ee18d38d4eb001dd6 2026-05-08 02:29:21,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:29:21,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa76ee18d38d4eb001dd6 HTTP/1.1" 200 None 2026-05-08 02:29:21,336 - lava_callback - DEBUG - Processing node 69faa76ee18d38d4eb001dd6: baseline-arm-clabbe 2026-05-08 02:29:21,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa76ee18d38d4eb001dd6 2026-05-08 02:29:21,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:29:21,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa76ee18d38d4eb001dd6 HTTP/1.1" 200 None 2026-05-08 02:29:21,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:29:21,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:29:21,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:29:21,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa76ee18d38d4eb001dd6 HTTP/1.1" 200 None 2026-05-08 02:29:21,382 - lava_callback - ERROR - Error processing callback for node 69faa76ee18d38d4eb001dd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48782 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:30:01,271 - lava_callback - INFO - Received callback for node 69faa793e18d38d4eb001de7 INFO: 172.20.0.1:45530 - "POST /node/69faa793e18d38d4eb001de7 HTTP/1.0" 202 Accepted 2026-05-08 02:30:01,277 - lava_callback - INFO - Starting async job submit for node 69faa793e18d38d4eb001de7 2026-05-08 02:30:01,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:30:01,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa793e18d38d4eb001de7 HTTP/1.1" 200 None 2026-05-08 02:30:01,291 - lava_callback - DEBUG - Processing node 69faa793e18d38d4eb001de7: baseline-arm-clabbe 2026-05-08 02:30:01,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faa793e18d38d4eb001de7 2026-05-08 02:30:01,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:30:01,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faa793e18d38d4eb001de7 HTTP/1.1" 200 None 2026-05-08 02:30:01,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:30:01,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f29fc4e2fa3d7693ba43ae HTTP/1.1" 200 None 2026-05-08 02:30:01,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:30:01,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faa793e18d38d4eb001de7 HTTP/1.1" 200 None 2026-05-08 02:30:01,337 - lava_callback - ERROR - Error processing callback for node 69faa793e18d38d4eb001de7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:31:28,795 - lava_callback - INFO - Received callback for node 69fd45ff197af08e45fc62e2 INFO: 172.20.0.1:42376 - "POST /node/69fd45ff197af08e45fc62e2 HTTP/1.0" 202 Accepted 2026-05-08 02:31:28,841 - lava_callback - INFO - Starting async job submit for node 69fd45ff197af08e45fc62e2 2026-05-08 02:31:28,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:28,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd45ff197af08e45fc62e2 HTTP/1.1" 200 None 2026-05-08 02:31:28,880 - lava_callback - DEBUG - Processing node 69fd45ff197af08e45fc62e2: baseline-arm-pengutronix 2026-05-08 02:31:28,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:31:29,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:31:29,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd45ff197af08e45fc62e2/log.txt.gz 2026-05-08 02:31:29,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:31:29,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:31:29,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd45ff197af08e45fc62e2/lava-logs.yaml 2026-05-08 02:31:29,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:31:29,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:31:29,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd45ff197af08e45fc62e2/lava_callback.json.gz DEBUG: Setup failed for 69fd45ff197af08e45fc62e2. Transitting job node result: incomplete -> fail 2026-05-08 02:31:29,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:29,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd45ff197af08e45fc62e2 HTTP/1.1" 200 None 2026-05-08 02:31:29,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:29,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 02:31:29,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:29,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd45ff197af08e45fc62e2 HTTP/1.1" 200 None 2026-05-08 02:31:29,538 - lava_callback - INFO - Completed processing callback for node 69fd45ff197af08e45fc62e2 2026-05-08 02:31:31,589 - lava_callback - INFO - Received callback for node 69fd49c1197af08e45fc64b9 INFO: 172.20.0.1:58852 - "POST /node/69fd49c1197af08e45fc64b9 HTTP/1.0" 202 Accepted 2026-05-08 02:31:31,604 - lava_callback - INFO - Starting async job submit for node 69fd49c1197af08e45fc64b9 2026-05-08 02:31:31,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:31,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd49c1197af08e45fc64b9 HTTP/1.1" 200 None 2026-05-08 02:31:31,668 - lava_callback - DEBUG - Processing node 69fd49c1197af08e45fc64b9: baseline-arm64-foundriesio 2026-05-08 02:31:32,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:31:33,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:31:33,027 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd49c1197af08e45fc64b9/log.txt.gz 2026-05-08 02:31:33,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:31:33,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:31:33,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd49c1197af08e45fc64b9/lava-logs.yaml 2026-05-08 02:31:33,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:31:34,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:31:34,088 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd49c1197af08e45fc64b9/lava_callback.json.gz DEBUG: 69fd49c1197af08e45fc64b9 Transitting job node result: pass -> incomplete 2026-05-08 02:31:34,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:34,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd49c1197af08e45fc64b9 HTTP/1.1" 200 None 2026-05-08 02:31:34,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:34,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:31:34,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:34,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd49c1197af08e45fc64b9 HTTP/1.1" 200 None 2026-05-08 02:31:34,204 - lava_callback - INFO - Completed processing callback for node 69fd49c1197af08e45fc64b9 INFO: 172.20.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38068 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:31:50,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:31:50,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53102 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:33:10,117 - lava_callback - INFO - Received callback for node 69fd4b41197af08e45fc6568 INFO: 172.20.0.1:39432 - "POST /node/69fd4b41197af08e45fc6568 HTTP/1.0" 202 Accepted 2026-05-08 02:33:10,126 - lava_callback - INFO - Starting async job submit for node 69fd4b41197af08e45fc6568 2026-05-08 02:33:10,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:33:10,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4b41197af08e45fc6568 HTTP/1.1" 200 None 2026-05-08 02:33:10,142 - lava_callback - DEBUG - Processing node 69fd4b41197af08e45fc6568: baseline-nfs-arm64 2026-05-08 02:33:10,144 - lava_callback - WARNING - Failed to upload log 2026-05-08 02:33:10,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:33:10,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:33:10,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4b41197af08e45fc6568/lava-logs.yaml 2026-05-08 02:33:10,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:33:10,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:33:10,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4b41197af08e45fc6568/lava_callback.json.gz 2026-05-08 02:33:10,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:33:10,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4b41197af08e45fc6568 HTTP/1.1" 200 None 2026-05-08 02:33:10,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:33:10,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:33:10,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:33:10,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4b41197af08e45fc6568 HTTP/1.1" 200 None 2026-05-08 02:33:10,385 - lava_callback - INFO - Completed processing callback for node 69fd4b41197af08e45fc6568 INFO: 172.20.0.1:39438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39448 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:33:20,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:33:20,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50714 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:36:04,948 - lava_callback - INFO - Received callback for node 69fd4bce197af08e45fc65d1 INFO: 172.20.0.1:45784 - "POST /node/69fd4bce197af08e45fc65d1 HTTP/1.0" 202 Accepted 2026-05-08 02:36:04,955 - lava_callback - INFO - Starting async job submit for node 69fd4bce197af08e45fc65d1 2026-05-08 02:36:04,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4bce197af08e45fc65d1 HTTP/1.1" 200 None 2026-05-08 02:36:04,997 - lava_callback - DEBUG - Processing node 69fd4bce197af08e45fc65d1: baseline-arm64 2026-05-08 02:36:05,128 - lava_callback - WARNING - Failed to upload log 2026-05-08 02:36:05,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:36:05,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:36:05,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4bce197af08e45fc65d1/lava-logs.yaml 2026-05-08 02:36:05,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:36:05,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:36:05,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4bce197af08e45fc65d1/lava_callback.json.gz 2026-05-08 02:36:05,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:05,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4bce197af08e45fc65d1 HTTP/1.1" 200 None 2026-05-08 02:36:05,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:05,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:36:05,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:05,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4bce197af08e45fc65d1 HTTP/1.1" 200 None 2026-05-08 02:36:05,688 - lava_callback - INFO - Completed processing callback for node 69fd4bce197af08e45fc65d1 INFO: 172.20.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56352 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:36:20,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:20,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:36:55,724 - lava_callback - INFO - Received callback for node 69fd4af0197af08e45fc653a INFO: 172.20.0.1:40624 - "POST /node/69fd4af0197af08e45fc653a HTTP/1.0" 202 Accepted 2026-05-08 02:36:55,731 - lava_callback - INFO - Starting async job submit for node 69fd4af0197af08e45fc653a 2026-05-08 02:36:55,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:55,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4af0197af08e45fc653a HTTP/1.1" 200 None 2026-05-08 02:36:55,786 - lava_callback - DEBUG - Processing node 69fd4af0197af08e45fc653a: baseline-arm64 2026-05-08 02:36:56,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:36:56,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:36:56,261 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4af0197af08e45fc653a/log.txt.gz 2026-05-08 02:36:56,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40628 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:36:56,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:36:56,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4af0197af08e45fc653a/lava-logs.yaml 2026-05-08 02:36:56,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:36:56,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:36:56,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4af0197af08e45fc653a/lava_callback.json.gz DEBUG: Setup failed for 69fd4af0197af08e45fc653a. Transitting job node result: incomplete -> fail 2026-05-08 02:36:56,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:56,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4af0197af08e45fc653a HTTP/1.1" 200 None 2026-05-08 02:36:56,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:56,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:36:56,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:36:56,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4af0197af08e45fc653a HTTP/1.1" 200 None 2026-05-08 02:36:57,045 - lava_callback - INFO - Completed processing callback for node 69fd4af0197af08e45fc653a INFO: 172.20.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52180 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:37:20,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:37:20,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET /node/69876aafe31b58f834f19725%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46828 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:39:35,504 - lava_callback - INFO - Received callback for node 69fd4cba197af08e45fc6653 INFO: 172.20.0.1:37442 - "POST /node/69fd4cba197af08e45fc6653 HTTP/1.0" 202 Accepted 2026-05-08 02:39:35,514 - lava_callback - INFO - Starting async job submit for node 69fd4cba197af08e45fc6653 2026-05-08 02:39:35,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:39:35,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4cba197af08e45fc6653 HTTP/1.1" 200 None 2026-05-08 02:39:35,581 - lava_callback - DEBUG - Processing node 69fd4cba197af08e45fc6653: baseline-arm64 2026-05-08 02:39:35,757 - lava_callback - WARNING - Failed to upload log 2026-05-08 02:39:35,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:39:35,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:39:35,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4cba197af08e45fc6653/lava-logs.yaml 2026-05-08 02:39:35,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:39:36,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:39:36,063 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4cba197af08e45fc6653/lava_callback.json.gz 2026-05-08 02:39:36,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:39:36,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4cba197af08e45fc6653 HTTP/1.1" 200 None 2026-05-08 02:39:36,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:39:36,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:39:36,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:39:36,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4cba197af08e45fc6653 HTTP/1.1" 200 None 2026-05-08 02:39:36,196 - lava_callback - INFO - Completed processing callback for node 69fd4cba197af08e45fc6653 INFO: 172.20.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39820 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:39:50,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:39:50,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35388 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:40:35,947 - lava_callback - INFO - Received callback for node 69fd4b92197af08e45fc65a5 INFO: 172.20.0.1:55456 - "POST /node/69fd4b92197af08e45fc65a5 HTTP/1.0" 202 Accepted 2026-05-08 02:40:35,957 - lava_callback - INFO - Starting async job submit for node 69fd4b92197af08e45fc65a5 2026-05-08 02:40:35,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:40:36,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4b92197af08e45fc65a5 HTTP/1.1" 200 None 2026-05-08 02:40:36,012 - lava_callback - DEBUG - Processing node 69fd4b92197af08e45fc65a5: baseline-arm64-broonie 2026-05-08 02:40:36,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:40:36,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:40:36,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd4b92197af08e45fc65a5/log.txt.gz INFO: 172.20.0.1:55464 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:40:36,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:40:36,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:40:36,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd4b92197af08e45fc65a5/lava-logs.yaml 2026-05-08 02:40:36,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:40:36,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:40:36,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fd4b92197af08e45fc65a5/lava_callback.json.gz 2026-05-08 02:40:36,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:40:36,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4b92197af08e45fc65a5 HTTP/1.1" 200 None 2026-05-08 02:40:36,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:40:36,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:40:36,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:40:36,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4b92197af08e45fc65a5 HTTP/1.1" 200 None 2026-05-08 02:40:36,957 - lava_callback - INFO - Completed processing callback for node 69fd4b92197af08e45fc65a5 INFO: 172.20.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:40:50,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:40:50,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49084 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:44:06,420 - lava_callback - INFO - Received callback for node 69faaaf4e18d38d4eb001e92 INFO: 172.20.0.1:50062 - "POST /node/69faaaf4e18d38d4eb001e92 HTTP/1.0" 202 Accepted 2026-05-08 02:44:06,426 - lava_callback - INFO - Starting async job submit for node 69faaaf4e18d38d4eb001e92 2026-05-08 02:44:06,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:44:06,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faaaf4e18d38d4eb001e92 HTTP/1.1" 200 None 2026-05-08 02:44:06,442 - lava_callback - DEBUG - Processing node 69faaaf4e18d38d4eb001e92: baseline-arm-baylibre 2026-05-08 02:44:06,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faaaf4e18d38d4eb001e92 2026-05-08 02:44:06,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:44:06,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faaaf4e18d38d4eb001e92 HTTP/1.1" 200 None 2026-05-08 02:44:06,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:44:06,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:44:06,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:44:06,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faaaf4e18d38d4eb001e92 HTTP/1.1" 200 None 2026-05-08 02:44:06,497 - lava_callback - ERROR - Error processing callback for node 69faaaf4e18d38d4eb001e92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58058 - "GET /node/6992de0031166481c8dd55f1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60478 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:45:26,490 - lava_callback - INFO - Received callback for node 69faab31e18d38d4eb001ea3 INFO: 172.20.0.1:56608 - "POST /node/69faab31e18d38d4eb001ea3 HTTP/1.0" 202 Accepted 2026-05-08 02:45:26,497 - lava_callback - INFO - Starting async job submit for node 69faab31e18d38d4eb001ea3 2026-05-08 02:45:26,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:45:26,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faab31e18d38d4eb001ea3 HTTP/1.1" 200 None 2026-05-08 02:45:26,514 - lava_callback - DEBUG - Processing node 69faab31e18d38d4eb001ea3: baseline-arm-baylibre 2026-05-08 02:45:26,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faab31e18d38d4eb001ea3 2026-05-08 02:45:26,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:45:26,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faab31e18d38d4eb001ea3 HTTP/1.1" 200 None 2026-05-08 02:45:26,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:45:26,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:45:26,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:45:26,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faab31e18d38d4eb001ea3 HTTP/1.1" 200 None 2026-05-08 02:45:26,567 - lava_callback - ERROR - Error processing callback for node 69faab31e18d38d4eb001ea3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56624 - "GET /node/68ed9a7dc7da4797da292d5c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60844 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:45:46,829 - lava_callback - INFO - Received callback for node 69fd4e0c197af08e45fc6705 INFO: 172.20.0.1:60846 - "POST /node/69fd4e0c197af08e45fc6705 HTTP/1.0" 202 Accepted 2026-05-08 02:45:46,837 - lava_callback - INFO - Starting async job submit for node 69fd4e0c197af08e45fc6705 2026-05-08 02:45:46,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:45:46,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4e0c197af08e45fc6705 HTTP/1.1" 200 None 2026-05-08 02:45:46,887 - lava_callback - DEBUG - Processing node 69fd4e0c197af08e45fc6705: baseline-arm64-foundriesio 2026-05-08 02:45:47,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:45:47,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:45:47,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd4e0c197af08e45fc6705/log.txt.gz 2026-05-08 02:45:47,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:45:47,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:45:47,825 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd4e0c197af08e45fc6705/lava-logs.yaml 2026-05-08 02:45:47,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:45:47,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:45:47,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fd4e0c197af08e45fc6705/lava_callback.json.gz 2026-05-08 02:45:48,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:45:48,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4e0c197af08e45fc6705 HTTP/1.1" 200 None 2026-05-08 02:45:48,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:45:48,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:45:48,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:45:48,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4e0c197af08e45fc6705 HTTP/1.1" 200 None 2026-05-08 02:45:48,062 - lava_callback - INFO - Completed processing callback for node 69fd4e0c197af08e45fc6705 2026-05-08 02:45:50,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:45:50,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60270 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:47:26,564 - lava_callback - INFO - Received callback for node 69faabaae18d38d4eb001eb7 INFO: 172.20.0.1:60280 - "POST /node/69faabaae18d38d4eb001eb7 HTTP/1.0" 202 Accepted 2026-05-08 02:47:26,570 - lava_callback - INFO - Starting async job submit for node 69faabaae18d38d4eb001eb7 2026-05-08 02:47:26,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:47:26,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faabaae18d38d4eb001eb7 HTTP/1.1" 200 None 2026-05-08 02:47:26,594 - lava_callback - DEBUG - Processing node 69faabaae18d38d4eb001eb7: baseline-arm-baylibre 2026-05-08 02:47:26,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faabaae18d38d4eb001eb7 2026-05-08 02:47:26,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:47:26,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faabaae18d38d4eb001eb7 HTTP/1.1" 200 None 2026-05-08 02:47:26,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:47:26,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:47:26,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:47:26,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faabaae18d38d4eb001eb7 HTTP/1.1" 200 None 2026-05-08 02:47:26,641 - lava_callback - ERROR - Error processing callback for node 69faabaae18d38d4eb001eb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60284 - "GET /node/6986fb876e077e4126a7d469%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56494 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:48:06,569 - lava_callback - INFO - Received callback for node 69faabd1e18d38d4eb001ec4 INFO: 172.20.0.1:56498 - "POST /node/69faabd1e18d38d4eb001ec4 HTTP/1.0" 202 Accepted 2026-05-08 02:48:06,575 - lava_callback - INFO - Starting async job submit for node 69faabd1e18d38d4eb001ec4 2026-05-08 02:48:06,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:48:06,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faabd1e18d38d4eb001ec4 HTTP/1.1" 200 None 2026-05-08 02:48:06,596 - lava_callback - DEBUG - Processing node 69faabd1e18d38d4eb001ec4: baseline-arm-baylibre 2026-05-08 02:48:06,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faabd1e18d38d4eb001ec4 2026-05-08 02:48:06,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:48:06,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faabd1e18d38d4eb001ec4 HTTP/1.1" 200 None 2026-05-08 02:48:06,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:48:06,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:48:06,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:48:06,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faabd1e18d38d4eb001ec4 HTTP/1.1" 200 None 2026-05-08 02:48:06,642 - lava_callback - ERROR - Error processing callback for node 69faabd1e18d38d4eb001ec4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45814 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:48:26,559 - lava_callback - INFO - Received callback for node 69faabf6e18d38d4eb001ed7 INFO: 172.20.0.1:45822 - "POST /node/69faabf6e18d38d4eb001ed7 HTTP/1.0" 202 Accepted 2026-05-08 02:48:26,565 - lava_callback - INFO - Starting async job submit for node 69faabf6e18d38d4eb001ed7 2026-05-08 02:48:26,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:48:26,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faabf6e18d38d4eb001ed7 HTTP/1.1" 200 None 2026-05-08 02:48:26,582 - lava_callback - DEBUG - Processing node 69faabf6e18d38d4eb001ed7: baseline-arm-baylibre 2026-05-08 02:48:26,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faabf6e18d38d4eb001ed7 2026-05-08 02:48:26,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:48:26,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faabf6e18d38d4eb001ed7 HTTP/1.1" 200 None 2026-05-08 02:48:26,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:48:26,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:48:26,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:48:26,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faabf6e18d38d4eb001ed7 HTTP/1.1" 200 None 2026-05-08 02:48:26,652 - lava_callback - ERROR - Error processing callback for node 69faabf6e18d38d4eb001ed7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:49:26,616 - lava_callback - INFO - Received callback for node 69faac24e18d38d4eb001ee1 INFO: 172.20.0.1:44014 - "POST /node/69faac24e18d38d4eb001ee1 HTTP/1.0" 202 Accepted 2026-05-08 02:49:26,621 - lava_callback - INFO - Starting async job submit for node 69faac24e18d38d4eb001ee1 2026-05-08 02:49:26,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:49:26,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faac24e18d38d4eb001ee1 HTTP/1.1" 200 None 2026-05-08 02:49:26,636 - lava_callback - DEBUG - Processing node 69faac24e18d38d4eb001ee1: baseline-arm-baylibre 2026-05-08 02:49:26,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faac24e18d38d4eb001ee1 2026-05-08 02:49:26,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:49:26,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faac24e18d38d4eb001ee1 HTTP/1.1" 200 None 2026-05-08 02:49:26,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:49:26,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:49:26,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:49:26,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faac24e18d38d4eb001ee1 HTTP/1.1" 200 None 2026-05-08 02:49:26,683 - lava_callback - ERROR - Error processing callback for node 69faac24e18d38d4eb001ee1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:51:02,321 - lava_callback - INFO - Received callback for node 69fd4e46197af08e45fc6731 INFO: 172.20.0.1:41014 - "POST /node/69fd4e46197af08e45fc6731 HTTP/1.0" 202 Accepted 2026-05-08 02:51:02,328 - lava_callback - INFO - Starting async job submit for node 69fd4e46197af08e45fc6731 2026-05-08 02:51:02,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:02,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4e46197af08e45fc6731 HTTP/1.1" 200 None 2026-05-08 02:51:02,382 - lava_callback - DEBUG - Processing node 69fd4e46197af08e45fc6731: baseline-arm64 2026-05-08 02:51:02,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:51:02,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:51:02,985 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4e46197af08e45fc6731/log.txt.gz 2026-05-08 02:51:03,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:51:03,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:51:03,363 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4e46197af08e45fc6731/lava-logs.yaml 2026-05-08 02:51:03,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:51:03,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:51:03,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4e46197af08e45fc6731/lava_callback.json.gz DEBUG: Setup failed for 69fd4e46197af08e45fc6731. Transitting job node result: incomplete -> fail 2026-05-08 02:51:03,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:03,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4e46197af08e45fc6731 HTTP/1.1" 200 None 2026-05-08 02:51:03,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:03,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 02:51:03,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:03,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4e46197af08e45fc6731 HTTP/1.1" 200 None 2026-05-08 02:51:03,675 - lava_callback - INFO - Completed processing callback for node 69fd4e46197af08e45fc6731 INFO: 172.20.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59206 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:51:20,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:20,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48404 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:51:41,984 - lava_callback - INFO - Received callback for node 69faacaae18d38d4eb001f16 INFO: 172.20.0.1:57840 - "POST /node/69faacaae18d38d4eb001f16 HTTP/1.0" 202 Accepted 2026-05-08 02:51:41,990 - lava_callback - INFO - Starting async job submit for node 69faacaae18d38d4eb001f16 2026-05-08 02:51:41,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:42,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faacaae18d38d4eb001f16 HTTP/1.1" 200 None 2026-05-08 02:51:42,006 - lava_callback - DEBUG - Processing node 69faacaae18d38d4eb001f16: baseline-arm-clabbe 2026-05-08 02:51:42,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faacaae18d38d4eb001f16 2026-05-08 02:51:42,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:42,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faacaae18d38d4eb001f16 HTTP/1.1" 200 None 2026-05-08 02:51:42,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:42,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:51:42,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:51:42,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faacaae18d38d4eb001f16 HTTP/1.1" 200 None 2026-05-08 02:51:42,068 - lava_callback - ERROR - Error processing callback for node 69faacaae18d38d4eb001f16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38536 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:52:21,991 - lava_callback - INFO - Received callback for node 69faacdae18d38d4eb001f22 INFO: 172.20.0.1:34738 - "POST /node/69faacdae18d38d4eb001f22 HTTP/1.0" 202 Accepted 2026-05-08 02:52:21,997 - lava_callback - INFO - Starting async job submit for node 69faacdae18d38d4eb001f22 2026-05-08 02:52:21,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:52:22,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faacdae18d38d4eb001f22 HTTP/1.1" 200 None 2026-05-08 02:52:22,013 - lava_callback - DEBUG - Processing node 69faacdae18d38d4eb001f22: baseline-arm-clabbe 2026-05-08 02:52:22,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faacdae18d38d4eb001f22 2026-05-08 02:52:22,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:52:22,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faacdae18d38d4eb001f22 HTTP/1.1" 200 None 2026-05-08 02:52:22,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:52:22,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:52:22,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:52:22,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faacdae18d38d4eb001f22 HTTP/1.1" 200 None 2026-05-08 02:52:22,078 - lava_callback - ERROR - Error processing callback for node 69faacdae18d38d4eb001f22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57150 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:53:02,070 - lava_callback - INFO - Received callback for node 69faad01e18d38d4eb001f2f INFO: 172.20.0.1:38942 - "POST /node/69faad01e18d38d4eb001f2f HTTP/1.0" 202 Accepted 2026-05-08 02:53:02,076 - lava_callback - INFO - Starting async job submit for node 69faad01e18d38d4eb001f2f 2026-05-08 02:53:02,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:53:02,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faad01e18d38d4eb001f2f HTTP/1.1" 200 None 2026-05-08 02:53:02,091 - lava_callback - DEBUG - Processing node 69faad01e18d38d4eb001f2f: baseline-arm-clabbe 2026-05-08 02:53:02,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faad01e18d38d4eb001f2f 2026-05-08 02:53:02,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:53:02,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faad01e18d38d4eb001f2f HTTP/1.1" 200 None 2026-05-08 02:53:02,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:53:02,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:53:02,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:53:02,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faad01e18d38d4eb001f2f HTTP/1.1" 200 None 2026-05-08 02:53:02,137 - lava_callback - ERROR - Error processing callback for node 69faad01e18d38d4eb001f2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35120 - "GET /node/6993d5693e9ba49307714a27%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45668 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:55:22,132 - lava_callback - INFO - Received callback for node 69faad8ee18d38d4eb001f66 INFO: 172.20.0.1:49798 - "POST /node/69faad8ee18d38d4eb001f66 HTTP/1.0" 202 Accepted 2026-05-08 02:55:22,137 - lava_callback - INFO - Starting async job submit for node 69faad8ee18d38d4eb001f66 2026-05-08 02:55:22,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:55:22,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faad8ee18d38d4eb001f66 HTTP/1.1" 200 None 2026-05-08 02:55:22,153 - lava_callback - DEBUG - Processing node 69faad8ee18d38d4eb001f66: baseline-arm-clabbe 2026-05-08 02:55:22,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faad8ee18d38d4eb001f66 2026-05-08 02:55:22,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:55:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faad8ee18d38d4eb001f66 HTTP/1.1" 200 None 2026-05-08 02:55:22,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:55:22,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:55:22,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:55:22,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faad8ee18d38d4eb001f66 HTTP/1.1" 200 None 2026-05-08 02:55:22,205 - lava_callback - ERROR - Error processing callback for node 69faad8ee18d38d4eb001f66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53058 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:56:02,089 - lava_callback - INFO - Received callback for node 69faadb4e18d38d4eb001f74 INFO: 172.20.0.1:40366 - "POST /node/69faadb4e18d38d4eb001f74 HTTP/1.0" 202 Accepted 2026-05-08 02:56:02,095 - lava_callback - INFO - Starting async job submit for node 69faadb4e18d38d4eb001f74 2026-05-08 02:56:02,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:56:02,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faadb4e18d38d4eb001f74 HTTP/1.1" 200 None 2026-05-08 02:56:02,111 - lava_callback - DEBUG - Processing node 69faadb4e18d38d4eb001f74: baseline-arm-clabbe 2026-05-08 02:56:02,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faadb4e18d38d4eb001f74 2026-05-08 02:56:02,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:56:02,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faadb4e18d38d4eb001f74 HTTP/1.1" 200 None 2026-05-08 02:56:02,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:56:02,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:56:02,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:56:02,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faadb4e18d38d4eb001f74 HTTP/1.1" 200 None 2026-05-08 02:56:02,179 - lava_callback - ERROR - Error processing callback for node 69faadb4e18d38d4eb001f74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34754 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:56:42,210 - lava_callback - INFO - Received callback for node 69faaddae18d38d4eb001f84 INFO: 172.20.0.1:42768 - "POST /node/69faaddae18d38d4eb001f84 HTTP/1.0" 202 Accepted 2026-05-08 02:56:42,216 - lava_callback - INFO - Starting async job submit for node 69faaddae18d38d4eb001f84 2026-05-08 02:56:42,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:56:42,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faaddae18d38d4eb001f84 HTTP/1.1" 200 None 2026-05-08 02:56:42,231 - lava_callback - DEBUG - Processing node 69faaddae18d38d4eb001f84: baseline-arm-clabbe 2026-05-08 02:56:42,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faaddae18d38d4eb001f84 2026-05-08 02:56:42,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:56:42,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faaddae18d38d4eb001f84 HTTP/1.1" 200 None 2026-05-08 02:56:42,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:56:42,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-08 02:56:42,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:56:42,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faaddae18d38d4eb001f84 HTTP/1.1" 200 None 2026-05-08 02:56:42,277 - lava_callback - ERROR - Error processing callback for node 69faaddae18d38d4eb001f84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37014 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:58:24,964 - lava_callback - INFO - Received callback for node 69fd4d59197af08e45fc66a4 INFO: 172.20.0.1:47780 - "POST /node/69fd4d59197af08e45fc66a4 HTTP/1.0" 202 Accepted 2026-05-08 02:58:24,970 - lava_callback - INFO - Starting async job submit for node 69fd4d59197af08e45fc66a4 2026-05-08 02:58:25,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:58:25,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4d59197af08e45fc66a4 HTTP/1.1" 200 None 2026-05-08 02:58:25,037 - lava_callback - DEBUG - Processing node 69fd4d59197af08e45fc66a4: baseline-arm 2026-05-08 02:58:25,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:58:25,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:58:25,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fd4d59197af08e45fc66a4/log.txt.gz 2026-05-08 02:58:26,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:58:26,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:58:26,286 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fd4d59197af08e45fc66a4/lava-logs.yaml 2026-05-08 02:58:26,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:58:26,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:58:26,414 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fd4d59197af08e45fc66a4/lava_callback.json.gz DEBUG: Setup failed for 69fd4d59197af08e45fc66a4. Transitting job node result: incomplete -> fail INFO: 172.20.0.1:47786 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:58:26,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:58:26,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4d59197af08e45fc66a4 HTTP/1.1" 200 None 2026-05-08 02:58:26,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:58:26,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 02:58:26,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:58:26,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4d59197af08e45fc66a4 HTTP/1.1" 200 None 2026-05-08 02:58:26,671 - lava_callback - INFO - Completed processing callback for node 69fd4d59197af08e45fc66a4 INFO: 172.20.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53088 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:58:50,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:58:50,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55098 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:59:33,406 - lava_callback - INFO - Received callback for node 69fd4d7d197af08e45fc66b2 INFO: 172.20.0.1:53430 - "POST /node/69fd4d7d197af08e45fc66b2 HTTP/1.0" 202 Accepted 2026-05-08 02:59:33,413 - lava_callback - INFO - Starting async job submit for node 69fd4d7d197af08e45fc66b2 2026-05-08 02:59:33,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:59:33,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4d7d197af08e45fc66b2 HTTP/1.1" 200 None 2026-05-08 02:59:33,496 - lava_callback - DEBUG - Processing node 69fd4d7d197af08e45fc66b2: ltp-smoke 2026-05-08 02:59:33,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:59:34,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:59:34,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd4d7d197af08e45fc66b2/log.txt.gz 2026-05-08 02:59:34,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:59:34,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:59:34,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd4d7d197af08e45fc66b2/lava-logs.yaml 2026-05-08 02:59:34,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 02:59:34,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 02:59:34,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fd4d7d197af08e45fc66b2/lava_callback.json.gz 2026-05-08 02:59:34,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:59:34,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4d7d197af08e45fc66b2 HTTP/1.1" 200 None 2026-05-08 02:59:34,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:59:34,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf7197af08e45fc2dd5 HTTP/1.1" 200 None 2026-05-08 02:59:34,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:59:34,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4d7d197af08e45fc66b2 HTTP/1.1" 200 None 2026-05-08 02:59:34,946 - lava_callback - INFO - Completed processing callback for node 69fd4d7d197af08e45fc66b2 INFO: 172.20.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK 2026-05-08 02:59:50,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 02:59:50,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55894 - "GET /node/69e8f9e68327522856dae99a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:03:09,673 - lava_callback - INFO - Received callback for node 69fd4dda197af08e45fc66e8 INFO: 172.20.0.1:55286 - "POST /node/69fd4dda197af08e45fc66e8 HTTP/1.0" 202 Accepted 2026-05-08 03:03:09,721 - lava_callback - INFO - Starting async job submit for node 69fd4dda197af08e45fc66e8 2026-05-08 03:03:09,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:03:09,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4dda197af08e45fc66e8 HTTP/1.1" 200 None 2026-05-08 03:03:09,761 - lava_callback - DEBUG - Processing node 69fd4dda197af08e45fc66e8: baseline-arm-pengutronix 2026-05-08 03:03:09,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:03:09,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:03:09,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd4dda197af08e45fc66e8/log.txt.gz 2026-05-08 03:03:10,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:03:10,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:03:10,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd4dda197af08e45fc66e8/lava-logs.yaml 2026-05-08 03:03:10,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:03:10,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:03:10,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fd4dda197af08e45fc66e8/lava_callback.json.gz DEBUG: Setup failed for 69fd4dda197af08e45fc66e8. Transitting job node result: incomplete -> fail 2026-05-08 03:03:10,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:03:10,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4dda197af08e45fc66e8 HTTP/1.1" 200 None 2026-05-08 03:03:10,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:03:10,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-08 03:03:10,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:03:10,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4dda197af08e45fc66e8 HTTP/1.1" 200 None 2026-05-08 03:03:10,496 - lava_callback - INFO - Completed processing callback for node 69fd4dda197af08e45fc66e8 INFO: 172.20.0.1:39160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39170 - "GET /node/69f38df22fa6ff8e8ca90a66%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-08 03:03:20,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:03:20,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52150 - "GET /node/68eaa94f4c8d16b936076ce7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58760 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:37:02,882 - lava_callback - INFO - Received callback for node 69fd4d86197af08e45fc66b8 INFO: 172.20.0.1:59722 - "POST /node/69fd4d86197af08e45fc66b8 HTTP/1.0" 202 Accepted 2026-05-08 03:37:02,890 - lava_callback - INFO - Starting async job submit for node 69fd4d86197af08e45fc66b8 2026-05-08 03:37:02,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:37:02,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4d86197af08e45fc66b8 HTTP/1.1" 200 None 2026-05-08 03:37:02,953 - lava_callback - DEBUG - Processing node 69fd4d86197af08e45fc66b8: baseline-nfs-arm64 2026-05-08 03:37:04,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:37:04,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:37:04,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4d86197af08e45fc66b8/log.txt.gz 2026-05-08 03:37:04,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:37:04,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:37:04,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4d86197af08e45fc66b8/lava-logs.yaml 2026-05-08 03:37:05,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:37:05,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:37:05,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4d86197af08e45fc66b8/lava_callback.json.gz DEBUG: Setup failed for 69fd4d86197af08e45fc66b8. Transitting job node result: incomplete -> fail 2026-05-08 03:37:05,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:37:05,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4d86197af08e45fc66b8 HTTP/1.1" 200 None 2026-05-08 03:37:05,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:37:05,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 03:37:05,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:37:05,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4d86197af08e45fc66b8 HTTP/1.1" 200 None 2026-05-08 03:37:05,403 - lava_callback - INFO - Completed processing callback for node 69fd4d86197af08e45fc66b8 INFO: 172.20.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:37:20,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:37:20,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56996 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:41:55,614 - lava_callback - INFO - Received callback for node 69fd4d0d197af08e45fc6679 INFO: 172.20.0.1:57034 - "POST /node/69fd4d0d197af08e45fc6679 HTTP/1.0" 202 Accepted 2026-05-08 03:41:55,619 - lava_callback - INFO - Starting async job submit for node 69fd4d0d197af08e45fc6679 2026-05-08 03:41:55,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:41:55,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4d0d197af08e45fc6679 HTTP/1.1" 200 None 2026-05-08 03:41:55,652 - lava_callback - DEBUG - Processing node 69fd4d0d197af08e45fc6679: baseline-arm64 2026-05-08 03:41:55,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:41:56,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:41:56,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4d0d197af08e45fc6679/log.txt.gz 2026-05-08 03:41:56,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:41:56,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:41:56,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4d0d197af08e45fc6679/lava-logs.yaml 2026-05-08 03:41:56,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57038 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:41:56,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:41:56,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4d0d197af08e45fc6679/lava_callback.json.gz 2026-05-08 03:41:56,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:41:56,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4d0d197af08e45fc6679 HTTP/1.1" 200 None 2026-05-08 03:41:56,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:41:56,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 03:41:56,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:41:56,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4d0d197af08e45fc6679 HTTP/1.1" 200 None 2026-05-08 03:41:56,775 - lava_callback - INFO - Completed processing callback for node 69fd4d0d197af08e45fc6679 INFO: 172.20.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39616 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:42:20,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:42:20,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33312 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:46:29,800 - lava_callback - INFO - Received callback for node 69fab98ce18d38d4eb002094 INFO: 172.20.0.1:32774 - "POST /node/69fab98ce18d38d4eb002094 HTTP/1.0" 202 Accepted 2026-05-08 03:46:29,805 - lava_callback - INFO - Starting async job submit for node 69fab98ce18d38d4eb002094 2026-05-08 03:46:29,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:46:29,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fab98ce18d38d4eb002094 HTTP/1.1" 200 None 2026-05-08 03:46:29,820 - lava_callback - DEBUG - Processing node 69fab98ce18d38d4eb002094: baseline-arm64-baylibre 2026-05-08 03:46:29,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fab98ce18d38d4eb002094 2026-05-08 03:46:29,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:46:29,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fab98ce18d38d4eb002094 HTTP/1.1" 200 None 2026-05-08 03:46:29,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:46:29,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:46:29,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:46:29,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fab98ce18d38d4eb002094 HTTP/1.1" 200 None 2026-05-08 03:46:29,868 - lava_callback - ERROR - Error processing callback for node 69fab98ce18d38d4eb002094: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33342 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:47:49,932 - lava_callback - INFO - Received callback for node 69fab9dee18d38d4eb0020b5 INFO: 172.20.0.1:51736 - "POST /node/69fab9dee18d38d4eb0020b5 HTTP/1.0" 202 Accepted 2026-05-08 03:47:49,940 - lava_callback - INFO - Starting async job submit for node 69fab9dee18d38d4eb0020b5 2026-05-08 03:47:49,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:47:49,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fab9dee18d38d4eb0020b5 HTTP/1.1" 200 None 2026-05-08 03:47:49,959 - lava_callback - DEBUG - Processing node 69fab9dee18d38d4eb0020b5: baseline-arm64-baylibre 2026-05-08 03:47:49,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fab9dee18d38d4eb0020b5 2026-05-08 03:47:49,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:47:49,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fab9dee18d38d4eb0020b5 HTTP/1.1" 200 None 2026-05-08 03:47:49,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:47:49,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:47:49,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:47:50,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fab9dee18d38d4eb0020b5 HTTP/1.1" 200 None 2026-05-08 03:47:50,016 - lava_callback - ERROR - Error processing callback for node 69fab9dee18d38d4eb0020b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51910 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:49:09,883 - lava_callback - INFO - Received callback for node 69faba31e18d38d4eb0020d7 INFO: 172.20.0.1:51546 - "POST /node/69faba31e18d38d4eb0020d7 HTTP/1.0" 202 Accepted 2026-05-08 03:49:09,889 - lava_callback - INFO - Starting async job submit for node 69faba31e18d38d4eb0020d7 2026-05-08 03:49:09,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:49:09,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faba31e18d38d4eb0020d7 HTTP/1.1" 200 None 2026-05-08 03:49:09,903 - lava_callback - DEBUG - Processing node 69faba31e18d38d4eb0020d7: baseline-arm64-baylibre 2026-05-08 03:49:09,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faba31e18d38d4eb0020d7 2026-05-08 03:49:09,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:49:09,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faba31e18d38d4eb0020d7 HTTP/1.1" 200 None 2026-05-08 03:49:09,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:49:09,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:49:09,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:49:09,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faba31e18d38d4eb0020d7 HTTP/1.1" 200 None 2026-05-08 03:49:09,960 - lava_callback - ERROR - Error processing callback for node 69faba31e18d38d4eb0020d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46948 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:50:30,167 - lava_callback - INFO - Received callback for node 69faba7ee18d38d4eb0020f5 INFO: 172.20.0.1:34450 - "POST /node/69faba7ee18d38d4eb0020f5 HTTP/1.0" 202 Accepted 2026-05-08 03:50:30,172 - lava_callback - INFO - Starting async job submit for node 69faba7ee18d38d4eb0020f5 2026-05-08 03:50:30,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:50:30,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faba7ee18d38d4eb0020f5 HTTP/1.1" 200 None 2026-05-08 03:50:30,191 - lava_callback - DEBUG - Processing node 69faba7ee18d38d4eb0020f5: baseline-arm64-baylibre 2026-05-08 03:50:30,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faba7ee18d38d4eb0020f5 2026-05-08 03:50:30,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:50:30,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faba7ee18d38d4eb0020f5 HTTP/1.1" 200 None 2026-05-08 03:50:30,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:50:30,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:50:30,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:50:30,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faba7ee18d38d4eb0020f5 HTTP/1.1" 200 None 2026-05-08 03:50:30,240 - lava_callback - ERROR - Error processing callback for node 69faba7ee18d38d4eb0020f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57060 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:51:50,182 - lava_callback - INFO - Received callback for node 69fabacbe18d38d4eb002118 INFO: 172.20.0.1:39572 - "POST /node/69fabacbe18d38d4eb002118 HTTP/1.0" 202 Accepted 2026-05-08 03:51:50,188 - lava_callback - INFO - Starting async job submit for node 69fabacbe18d38d4eb002118 2026-05-08 03:51:50,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:51:50,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabacbe18d38d4eb002118 HTTP/1.1" 200 None 2026-05-08 03:51:50,208 - lava_callback - DEBUG - Processing node 69fabacbe18d38d4eb002118: baseline-arm64-baylibre 2026-05-08 03:51:50,208 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fabacbe18d38d4eb002118 2026-05-08 03:51:50,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:51:50,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabacbe18d38d4eb002118 HTTP/1.1" 200 None 2026-05-08 03:51:50,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:51:50,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:51:50,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:51:50,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fabacbe18d38d4eb002118 HTTP/1.1" 200 None 2026-05-08 03:51:50,256 - lava_callback - ERROR - Error processing callback for node 69fabacbe18d38d4eb002118: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:53:30,130 - lava_callback - INFO - Received callback for node 69fabb25e18d38d4eb002139 INFO: 172.20.0.1:52728 - "POST /node/69fabb25e18d38d4eb002139 HTTP/1.0" 202 Accepted 2026-05-08 03:53:30,136 - lava_callback - INFO - Starting async job submit for node 69fabb25e18d38d4eb002139 2026-05-08 03:53:30,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:53:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabb25e18d38d4eb002139 HTTP/1.1" 200 None 2026-05-08 03:53:30,151 - lava_callback - DEBUG - Processing node 69fabb25e18d38d4eb002139: baseline-arm64-baylibre 2026-05-08 03:53:30,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fabb25e18d38d4eb002139 2026-05-08 03:53:30,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:53:30,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabb25e18d38d4eb002139 HTTP/1.1" 200 None 2026-05-08 03:53:30,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:53:30,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:53:30,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:53:30,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fabb25e18d38d4eb002139 HTTP/1.1" 200 None 2026-05-08 03:53:30,207 - lava_callback - ERROR - Error processing callback for node 69fabb25e18d38d4eb002139: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45518 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:54:44,533 - lava_callback - INFO - Received callback for node 69fabb79e18d38d4eb00215d INFO: 172.20.0.1:44562 - "POST /node/69fabb79e18d38d4eb00215d HTTP/1.0" 202 Accepted 2026-05-08 03:54:44,538 - lava_callback - INFO - Starting async job submit for node 69fabb79e18d38d4eb00215d 2026-05-08 03:54:44,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:54:44,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabb79e18d38d4eb00215d HTTP/1.1" 200 None 2026-05-08 03:54:44,554 - lava_callback - DEBUG - Processing node 69fabb79e18d38d4eb00215d: baseline-arm64-clabbe 2026-05-08 03:54:44,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fabb79e18d38d4eb00215d 2026-05-08 03:54:44,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:54:44,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabb79e18d38d4eb00215d HTTP/1.1" 200 None 2026-05-08 03:54:44,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:54:44,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:54:44,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:54:44,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fabb79e18d38d4eb00215d HTTP/1.1" 200 None 2026-05-08 03:54:44,602 - lava_callback - ERROR - Error processing callback for node 69fabb79e18d38d4eb00215d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39770 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:56:04,524 - lava_callback - INFO - Received callback for node 69fabbc6e18d38d4eb00217b INFO: 172.20.0.1:50960 - "POST /node/69fabbc6e18d38d4eb00217b HTTP/1.0" 202 Accepted 2026-05-08 03:56:04,529 - lava_callback - INFO - Starting async job submit for node 69fabbc6e18d38d4eb00217b 2026-05-08 03:56:04,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:56:04,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabbc6e18d38d4eb00217b HTTP/1.1" 200 None 2026-05-08 03:56:04,545 - lava_callback - DEBUG - Processing node 69fabbc6e18d38d4eb00217b: baseline-arm64-clabbe 2026-05-08 03:56:04,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fabbc6e18d38d4eb00217b 2026-05-08 03:56:04,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:56:04,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabbc6e18d38d4eb00217b HTTP/1.1" 200 None 2026-05-08 03:56:04,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:56:04,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:56:04,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:56:04,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fabbc6e18d38d4eb00217b HTTP/1.1" 200 None 2026-05-08 03:56:04,591 - lava_callback - ERROR - Error processing callback for node 69fabbc6e18d38d4eb00217b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37102 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:57:14,156 - lava_callback - INFO - Received callback for node 69fd5a6a197af08e45fc6890 INFO: 172.20.0.1:54646 - "POST /node/69fd5a6a197af08e45fc6890 HTTP/1.0" 202 Accepted 2026-05-08 03:57:14,164 - lava_callback - INFO - Starting async job submit for node 69fd5a6a197af08e45fc6890 2026-05-08 03:57:14,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:14,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd5a6a197af08e45fc6890 HTTP/1.1" 200 None 2026-05-08 03:57:14,222 - lava_callback - DEBUG - Processing node 69fd5a6a197af08e45fc6890: baseline-nfs-arm64 INFO: 172.20.0.1:54650 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 03:57:15,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:57:15,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:57:15,516 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd5a6a197af08e45fc6890/log.txt.gz 2026-05-08 03:57:16,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:57:16,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:57:16,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd5a6a197af08e45fc6890/lava-logs.yaml 2026-05-08 03:57:16,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 03:57:16,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 03:57:16,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd5a6a197af08e45fc6890/lava_callback.json.gz INFO: 172.20.0.1:54656 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 69fd5a6a197af08e45fc6890. Transitting job node result: incomplete -> fail 2026-05-08 03:57:16,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:16,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd5a6a197af08e45fc6890 HTTP/1.1" 200 None 2026-05-08 03:57:16,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:16,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 03:57:16,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:16,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd5a6a197af08e45fc6890 HTTP/1.1" 200 None 2026-05-08 03:57:16,757 - lava_callback - INFO - Completed processing callback for node 69fd5a6a197af08e45fc6890 2026-05-08 03:57:20,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:20,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 03:57:24,557 - lava_callback - INFO - Received callback for node 69fabc12e18d38d4eb00219e INFO: 172.20.0.1:60546 - "POST /node/69fabc12e18d38d4eb00219e HTTP/1.0" 202 Accepted 2026-05-08 03:57:24,562 - lava_callback - INFO - Starting async job submit for node 69fabc12e18d38d4eb00219e 2026-05-08 03:57:24,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:24,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabc12e18d38d4eb00219e HTTP/1.1" 200 None 2026-05-08 03:57:24,577 - lava_callback - DEBUG - Processing node 69fabc12e18d38d4eb00219e: baseline-arm64-clabbe 2026-05-08 03:57:24,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fabc12e18d38d4eb00219e 2026-05-08 03:57:24,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:24,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabc12e18d38d4eb00219e HTTP/1.1" 200 None 2026-05-08 03:57:24,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:24,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:57:24,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:57:24,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fabc12e18d38d4eb00219e HTTP/1.1" 200 None 2026-05-08 03:57:24,625 - lava_callback - ERROR - Error processing callback for node 69fabc12e18d38d4eb00219e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54738 - "GET / HTTP/1.0" 200 OK 2026-05-08 03:58:44,579 - lava_callback - INFO - Received callback for node 69fabc65e18d38d4eb0021c2 INFO: 172.20.0.1:41596 - "POST /node/69fabc65e18d38d4eb0021c2 HTTP/1.0" 202 Accepted 2026-05-08 03:58:44,585 - lava_callback - INFO - Starting async job submit for node 69fabc65e18d38d4eb0021c2 2026-05-08 03:58:44,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:58:44,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabc65e18d38d4eb0021c2 HTTP/1.1" 200 None 2026-05-08 03:58:44,600 - lava_callback - DEBUG - Processing node 69fabc65e18d38d4eb0021c2: baseline-arm64-clabbe 2026-05-08 03:58:44,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fabc65e18d38d4eb0021c2 2026-05-08 03:58:44,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:58:44,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabc65e18d38d4eb0021c2 HTTP/1.1" 200 None 2026-05-08 03:58:44,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:58:44,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 03:58:44,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 03:58:44,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fabc65e18d38d4eb0021c2 HTTP/1.1" 200 None 2026-05-08 03:58:44,645 - lava_callback - ERROR - Error processing callback for node 69fabc65e18d38d4eb0021c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44322 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:00:05,016 - lava_callback - INFO - Received callback for node 69fabcb2e18d38d4eb0021de INFO: 172.20.0.1:42950 - "POST /node/69fabcb2e18d38d4eb0021de HTTP/1.0" 202 Accepted 2026-05-08 04:00:05,021 - lava_callback - INFO - Starting async job submit for node 69fabcb2e18d38d4eb0021de 2026-05-08 04:00:05,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:00:05,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabcb2e18d38d4eb0021de HTTP/1.1" 200 None 2026-05-08 04:00:05,046 - lava_callback - DEBUG - Processing node 69fabcb2e18d38d4eb0021de: baseline-arm64-clabbe 2026-05-08 04:00:05,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fabcb2e18d38d4eb0021de 2026-05-08 04:00:05,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:00:05,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabcb2e18d38d4eb0021de HTTP/1.1" 200 None 2026-05-08 04:00:05,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:00:05,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 04:00:05,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:00:05,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fabcb2e18d38d4eb0021de HTTP/1.1" 200 None 2026-05-08 04:00:05,092 - lava_callback - ERROR - Error processing callback for node 69fabcb2e18d38d4eb0021de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33192 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:02:44,769 - lava_callback - INFO - Received callback for node 69fabd54e18d38d4eb002227 INFO: 172.20.0.1:51688 - "POST /node/69fabd54e18d38d4eb002227 HTTP/1.0" 202 Accepted 2026-05-08 04:02:44,775 - lava_callback - INFO - Starting async job submit for node 69fabd54e18d38d4eb002227 2026-05-08 04:02:44,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:02:44,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabd54e18d38d4eb002227 HTTP/1.1" 200 None 2026-05-08 04:02:44,790 - lava_callback - DEBUG - Processing node 69fabd54e18d38d4eb002227: baseline-arm64-clabbe 2026-05-08 04:02:44,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fabd54e18d38d4eb002227 2026-05-08 04:02:44,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:02:44,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fabd54e18d38d4eb002227 HTTP/1.1" 200 None 2026-05-08 04:02:44,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:02:44,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-08 04:02:44,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:02:44,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fabd54e18d38d4eb002227 HTTP/1.1" 200 None 2026-05-08 04:02:44,845 - lava_callback - ERROR - Error processing callback for node 69fabd54e18d38d4eb002227: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56498 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:05:23,755 - lava_callback - INFO - Received callback for node 69fd4c1e197af08e45fc6606 INFO: 172.20.0.1:53608 - "POST /node/69fd4c1e197af08e45fc6606 HTTP/1.0" 202 Accepted 2026-05-08 04:05:23,761 - lava_callback - INFO - Starting async job submit for node 69fd4c1e197af08e45fc6606 2026-05-08 04:05:23,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:05:23,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4c1e197af08e45fc6606 HTTP/1.1" 200 None 2026-05-08 04:05:23,825 - lava_callback - DEBUG - Processing node 69fd4c1e197af08e45fc6606: baseline-arm64 2026-05-08 04:05:24,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 04:05:24,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:05:24,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4c1e197af08e45fc6606/log.txt.gz 2026-05-08 04:05:24,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 04:05:24,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:05:24,924 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4c1e197af08e45fc6606/lava-logs.yaml 2026-05-08 04:05:24,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 04:05:25,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:05:25,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fd4c1e197af08e45fc6606/lava_callback.json.gz 2026-05-08 04:05:25,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:05:25,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4c1e197af08e45fc6606 HTTP/1.1" 200 None 2026-05-08 04:05:25,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:05:25,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 04:05:25,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:05:25,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4c1e197af08e45fc6606 HTTP/1.1" 200 None 2026-05-08 04:05:25,178 - lava_callback - INFO - Completed processing callback for node 69fd4c1e197af08e45fc6606 INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43806 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:05:50,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:05:50,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53676 - "GET /node/69278dac97dccbdf516a6924%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54568 - "GET /node/698700036e077e4126a7e165%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60908 - "GET /node/6990a626c45febfe445208eb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48870 - "GET /node/69f5b80e8cb8354ccaa5f025%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39398 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 04:37:15,423 - lava_callback - INFO - Received callback for node 69fd4c71197af08e45fc662e INFO: 172.20.0.1:39406 - "POST /node/69fd4c71197af08e45fc662e HTTP/1.0" 202 Accepted 2026-05-08 04:37:15,430 - lava_callback - INFO - Starting async job submit for node 69fd4c71197af08e45fc662e 2026-05-08 04:37:15,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:37:15,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4c71197af08e45fc662e HTTP/1.1" 200 None 2026-05-08 04:37:15,470 - lava_callback - DEBUG - Processing node 69fd4c71197af08e45fc662e: baseline-nfs-arm64 2026-05-08 04:37:15,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 04:37:16,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:37:16,078 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4c71197af08e45fc662e/log.txt.gz 2026-05-08 04:37:16,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 04:37:16,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:37:16,499 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4c71197af08e45fc662e/lava-logs.yaml 2026-05-08 04:37:16,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39410 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:37:16,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:37:16,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd4c71197af08e45fc662e/lava_callback.json.gz 2026-05-08 04:37:16,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:37:16,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4c71197af08e45fc662e HTTP/1.1" 200 None 2026-05-08 04:37:16,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:37:16,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 04:37:16,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:37:16,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4c71197af08e45fc662e HTTP/1.1" 200 None 2026-05-08 04:37:16,799 - lava_callback - INFO - Completed processing callback for node 69fd4c71197af08e45fc662e 2026-05-08 04:37:20,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:37:20,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52116 - "GET /node/69943c705ae459b9df3d5fc7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:48:12,592 - lava_callback - INFO - Received callback for node 69fd6887197af08e45fc6aa4 INFO: 172.20.0.1:48474 - "POST /node/69fd6887197af08e45fc6aa4 HTTP/1.0" 202 Accepted 2026-05-08 04:48:12,599 - lava_callback - INFO - Starting async job submit for node 69fd6887197af08e45fc6aa4 2026-05-08 04:48:12,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:48:12,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6887197af08e45fc6aa4 HTTP/1.1" 200 None 2026-05-08 04:48:12,641 - lava_callback - DEBUG - Processing node 69fd6887197af08e45fc6aa4: baseline-nfs-arm64 2026-05-08 04:48:13,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 04:48:13,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:48:13,259 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd6887197af08e45fc6aa4/log.txt.gz 2026-05-08 04:48:13,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 04:48:13,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:48:13,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd6887197af08e45fc6aa4/lava-logs.yaml 2026-05-08 04:48:13,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 04:48:13,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 04:48:13,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fd6887197af08e45fc6aa4/lava_callback.json.gz 2026-05-08 04:48:13,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:48:13,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6887197af08e45fc6aa4 HTTP/1.1" 200 None 2026-05-08 04:48:13,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:48:14,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-08 04:48:14,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:48:14,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6887197af08e45fc6aa4 HTTP/1.1" 200 None 2026-05-08 04:48:14,111 - lava_callback - INFO - Completed processing callback for node 69fd6887197af08e45fc6aa4 INFO: 172.20.0.1:48488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48490 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:48:20,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:48:20,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35542 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:53:33,562 - lava_callback - INFO - Received callback for node 69fac944e18d38d4eb00234b INFO: 172.20.0.1:55468 - "POST /node/69fac944e18d38d4eb00234b HTTP/1.0" 202 Accepted 2026-05-08 04:53:33,569 - lava_callback - INFO - Starting async job submit for node 69fac944e18d38d4eb00234b 2026-05-08 04:53:33,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:53:33,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fac944e18d38d4eb00234b HTTP/1.1" 200 None 2026-05-08 04:53:33,585 - lava_callback - DEBUG - Processing node 69fac944e18d38d4eb00234b: baseline-arm64-baylibre 2026-05-08 04:53:33,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fac944e18d38d4eb00234b 2026-05-08 04:53:33,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:53:33,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fac944e18d38d4eb00234b HTTP/1.1" 200 None 2026-05-08 04:53:33,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:53:33,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 04:53:33,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:53:33,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fac944e18d38d4eb00234b HTTP/1.1" 200 None 2026-05-08 04:53:33,645 - lava_callback - ERROR - Error processing callback for node 69fac944e18d38d4eb00234b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32882 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:54:53,582 - lava_callback - INFO - Received callback for node 69fac990e18d38d4eb002368 INFO: 172.20.0.1:36876 - "POST /node/69fac990e18d38d4eb002368 HTTP/1.0" 202 Accepted 2026-05-08 04:54:53,588 - lava_callback - INFO - Starting async job submit for node 69fac990e18d38d4eb002368 2026-05-08 04:54:53,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:54:53,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fac990e18d38d4eb002368 HTTP/1.1" 200 None 2026-05-08 04:54:53,603 - lava_callback - DEBUG - Processing node 69fac990e18d38d4eb002368: baseline-arm64-baylibre 2026-05-08 04:54:53,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fac990e18d38d4eb002368 2026-05-08 04:54:53,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:54:53,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fac990e18d38d4eb002368 HTTP/1.1" 200 None 2026-05-08 04:54:53,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:54:53,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 04:54:53,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:54:53,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fac990e18d38d4eb002368 HTTP/1.1" 200 None 2026-05-08 04:54:53,649 - lava_callback - ERROR - Error processing callback for node 69fac990e18d38d4eb002368: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:56:13,584 - lava_callback - INFO - Received callback for node 69fac9dae18d38d4eb00238d INFO: 172.20.0.1:32962 - "POST /node/69fac9dae18d38d4eb00238d HTTP/1.0" 202 Accepted 2026-05-08 04:56:13,592 - lava_callback - INFO - Starting async job submit for node 69fac9dae18d38d4eb00238d 2026-05-08 04:56:13,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:56:13,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fac9dae18d38d4eb00238d HTTP/1.1" 200 None 2026-05-08 04:56:13,608 - lava_callback - DEBUG - Processing node 69fac9dae18d38d4eb00238d: baseline-arm64-baylibre 2026-05-08 04:56:13,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fac9dae18d38d4eb00238d 2026-05-08 04:56:13,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:56:13,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fac9dae18d38d4eb00238d HTTP/1.1" 200 None 2026-05-08 04:56:13,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:56:13,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 04:56:13,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:56:13,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fac9dae18d38d4eb00238d HTTP/1.1" 200 None 2026-05-08 04:56:13,676 - lava_callback - ERROR - Error processing callback for node 69fac9dae18d38d4eb00238d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49082 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:57:33,630 - lava_callback - INFO - Received callback for node 69faca29e18d38d4eb0023ac INFO: 172.20.0.1:40066 - "POST /node/69faca29e18d38d4eb0023ac HTTP/1.0" 202 Accepted 2026-05-08 04:57:33,636 - lava_callback - INFO - Starting async job submit for node 69faca29e18d38d4eb0023ac 2026-05-08 04:57:33,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:57:33,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faca29e18d38d4eb0023ac HTTP/1.1" 200 None 2026-05-08 04:57:33,654 - lava_callback - DEBUG - Processing node 69faca29e18d38d4eb0023ac: baseline-arm64-baylibre 2026-05-08 04:57:33,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faca29e18d38d4eb0023ac 2026-05-08 04:57:33,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:57:33,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faca29e18d38d4eb0023ac HTTP/1.1" 200 None 2026-05-08 04:57:33,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:57:33,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 04:57:33,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:57:33,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faca29e18d38d4eb0023ac HTTP/1.1" 200 None 2026-05-08 04:57:33,700 - lava_callback - ERROR - Error processing callback for node 69faca29e18d38d4eb0023ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33930 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:58:33,750 - lava_callback - INFO - Received callback for node 69faca74e18d38d4eb0023d1 INFO: 172.20.0.1:54556 - "POST /node/69faca74e18d38d4eb0023d1 HTTP/1.0" 202 Accepted 2026-05-08 04:58:33,756 - lava_callback - INFO - Starting async job submit for node 69faca74e18d38d4eb0023d1 2026-05-08 04:58:33,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:58:33,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faca74e18d38d4eb0023d1 HTTP/1.1" 200 None 2026-05-08 04:58:33,777 - lava_callback - DEBUG - Processing node 69faca74e18d38d4eb0023d1: baseline-arm64-baylibre 2026-05-08 04:58:33,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faca74e18d38d4eb0023d1 2026-05-08 04:58:33,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:58:33,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faca74e18d38d4eb0023d1 HTTP/1.1" 200 None 2026-05-08 04:58:33,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:58:33,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 04:58:33,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:58:33,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faca74e18d38d4eb0023d1 HTTP/1.1" 200 None 2026-05-08 04:58:33,827 - lava_callback - ERROR - Error processing callback for node 69faca74e18d38d4eb0023d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42438 - "GET / HTTP/1.0" 200 OK 2026-05-08 04:59:53,744 - lava_callback - INFO - Received callback for node 69facabfe18d38d4eb0023f2 INFO: 172.20.0.1:45958 - "POST /node/69facabfe18d38d4eb0023f2 HTTP/1.0" 202 Accepted 2026-05-08 04:59:53,750 - lava_callback - INFO - Starting async job submit for node 69facabfe18d38d4eb0023f2 2026-05-08 04:59:53,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:59:53,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facabfe18d38d4eb0023f2 HTTP/1.1" 200 None 2026-05-08 04:59:53,765 - lava_callback - DEBUG - Processing node 69facabfe18d38d4eb0023f2: baseline-arm64-baylibre 2026-05-08 04:59:53,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facabfe18d38d4eb0023f2 2026-05-08 04:59:53,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:59:53,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facabfe18d38d4eb0023f2 HTTP/1.1" 200 None 2026-05-08 04:59:53,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:59:53,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 04:59:53,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 04:59:53,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facabfe18d38d4eb0023f2 HTTP/1.1" 200 None 2026-05-08 04:59:53,811 - lava_callback - ERROR - Error processing callback for node 69facabfe18d38d4eb0023f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40630 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:01:13,795 - lava_callback - INFO - Received callback for node 69facb0ae18d38d4eb002418 INFO: 172.20.0.1:36022 - "POST /node/69facb0ae18d38d4eb002418 HTTP/1.0" 202 Accepted 2026-05-08 05:01:13,801 - lava_callback - INFO - Starting async job submit for node 69facb0ae18d38d4eb002418 2026-05-08 05:01:13,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:01:13,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facb0ae18d38d4eb002418 HTTP/1.1" 200 None 2026-05-08 05:01:13,817 - lava_callback - DEBUG - Processing node 69facb0ae18d38d4eb002418: baseline-arm64-baylibre 2026-05-08 05:01:13,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facb0ae18d38d4eb002418 2026-05-08 05:01:13,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:01:13,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facb0ae18d38d4eb002418 HTTP/1.1" 200 None 2026-05-08 05:01:13,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:01:13,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:01:13,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:01:13,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facb0ae18d38d4eb002418 HTTP/1.1" 200 None 2026-05-08 05:01:13,864 - lava_callback - ERROR - Error processing callback for node 69facb0ae18d38d4eb002418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39336 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:02:33,901 - lava_callback - INFO - Received callback for node 69facb54e18d38d4eb002439 INFO: 172.20.0.1:55392 - "POST /node/69facb54e18d38d4eb002439 HTTP/1.0" 202 Accepted 2026-05-08 05:02:33,906 - lava_callback - INFO - Starting async job submit for node 69facb54e18d38d4eb002439 2026-05-08 05:02:33,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:02:33,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facb54e18d38d4eb002439 HTTP/1.1" 200 None 2026-05-08 05:02:33,929 - lava_callback - DEBUG - Processing node 69facb54e18d38d4eb002439: baseline-arm64-baylibre 2026-05-08 05:02:33,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facb54e18d38d4eb002439 2026-05-08 05:02:33,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:02:33,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facb54e18d38d4eb002439 HTTP/1.1" 200 None 2026-05-08 05:02:33,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:02:33,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 05:02:33,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:02:33,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facb54e18d38d4eb002439 HTTP/1.1" 200 None 2026-05-08 05:02:33,975 - lava_callback - ERROR - Error processing callback for node 69facb54e18d38d4eb002439: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33512 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:03:47,539 - lava_callback - INFO - Received callback for node 69facba5e18d38d4eb00245e INFO: 172.20.0.1:33516 - "POST /node/69facba5e18d38d4eb00245e HTTP/1.0" 202 Accepted 2026-05-08 05:03:47,545 - lava_callback - INFO - Starting async job submit for node 69facba5e18d38d4eb00245e 2026-05-08 05:03:47,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:03:47,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facba5e18d38d4eb00245e HTTP/1.1" 200 None 2026-05-08 05:03:47,561 - lava_callback - DEBUG - Processing node 69facba5e18d38d4eb00245e: baseline-arm64-clabbe 2026-05-08 05:03:47,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facba5e18d38d4eb00245e 2026-05-08 05:03:47,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:03:47,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facba5e18d38d4eb00245e HTTP/1.1" 200 None 2026-05-08 05:03:47,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:03:47,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:03:47,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:03:47,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facba5e18d38d4eb00245e HTTP/1.1" 200 None 2026-05-08 05:03:47,614 - lava_callback - ERROR - Error processing callback for node 69facba5e18d38d4eb00245e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34942 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:05:07,612 - lava_callback - INFO - Received callback for node 69facbf1e18d38d4eb00247d INFO: 172.20.0.1:34956 - "POST /node/69facbf1e18d38d4eb00247d HTTP/1.0" 202 Accepted 2026-05-08 05:05:07,617 - lava_callback - INFO - Starting async job submit for node 69facbf1e18d38d4eb00247d 2026-05-08 05:05:07,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:05:07,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facbf1e18d38d4eb00247d HTTP/1.1" 200 None 2026-05-08 05:05:07,632 - lava_callback - DEBUG - Processing node 69facbf1e18d38d4eb00247d: baseline-arm64-clabbe 2026-05-08 05:05:07,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facbf1e18d38d4eb00247d 2026-05-08 05:05:07,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:05:07,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facbf1e18d38d4eb00247d HTTP/1.1" 200 None 2026-05-08 05:05:07,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:05:07,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 05:05:07,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:05:07,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facbf1e18d38d4eb00247d HTTP/1.1" 200 None 2026-05-08 05:05:07,680 - lava_callback - ERROR - Error processing callback for node 69facbf1e18d38d4eb00247d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60268 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:06:27,374 - lava_callback - INFO - Received callback for node 69facc3de18d38d4eb0024a4 INFO: 172.20.0.1:60280 - "POST /node/69facc3de18d38d4eb0024a4 HTTP/1.0" 202 Accepted 2026-05-08 05:06:27,380 - lava_callback - INFO - Starting async job submit for node 69facc3de18d38d4eb0024a4 2026-05-08 05:06:27,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:06:27,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facc3de18d38d4eb0024a4 HTTP/1.1" 200 None 2026-05-08 05:06:27,395 - lava_callback - DEBUG - Processing node 69facc3de18d38d4eb0024a4: baseline-arm64-clabbe 2026-05-08 05:06:27,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facc3de18d38d4eb0024a4 2026-05-08 05:06:27,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:06:27,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facc3de18d38d4eb0024a4 HTTP/1.1" 200 None 2026-05-08 05:06:27,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:06:27,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:06:27,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:06:27,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facc3de18d38d4eb0024a4 HTTP/1.1" 200 None 2026-05-08 05:06:27,451 - lava_callback - ERROR - Error processing callback for node 69facc3de18d38d4eb0024a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41960 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:07:27,421 - lava_callback - INFO - Received callback for node 69facc8ae18d38d4eb0024c4 INFO: 172.20.0.1:41970 - "POST /node/69facc8ae18d38d4eb0024c4 HTTP/1.0" 202 Accepted 2026-05-08 05:07:27,426 - lava_callback - INFO - Starting async job submit for node 69facc8ae18d38d4eb0024c4 2026-05-08 05:07:27,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:07:27,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facc8ae18d38d4eb0024c4 HTTP/1.1" 200 None 2026-05-08 05:07:27,449 - lava_callback - DEBUG - Processing node 69facc8ae18d38d4eb0024c4: baseline-arm64-clabbe 2026-05-08 05:07:27,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facc8ae18d38d4eb0024c4 2026-05-08 05:07:27,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:07:27,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facc8ae18d38d4eb0024c4 HTTP/1.1" 200 None 2026-05-08 05:07:27,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:07:27,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 05:07:27,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:07:27,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facc8ae18d38d4eb0024c4 HTTP/1.1" 200 None 2026-05-08 05:07:27,494 - lava_callback - ERROR - Error processing callback for node 69facc8ae18d38d4eb0024c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49860 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:08:47,471 - lava_callback - INFO - Received callback for node 69faccd8e18d38d4eb0024e7 INFO: 172.20.0.1:49870 - "POST /node/69faccd8e18d38d4eb0024e7 HTTP/1.0" 202 Accepted 2026-05-08 05:08:47,477 - lava_callback - INFO - Starting async job submit for node 69faccd8e18d38d4eb0024e7 2026-05-08 05:08:47,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:08:47,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faccd8e18d38d4eb0024e7 HTTP/1.1" 200 None 2026-05-08 05:08:47,492 - lava_callback - DEBUG - Processing node 69faccd8e18d38d4eb0024e7: baseline-arm64-clabbe 2026-05-08 05:08:47,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faccd8e18d38d4eb0024e7 2026-05-08 05:08:47,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:08:47,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faccd8e18d38d4eb0024e7 HTTP/1.1" 200 None 2026-05-08 05:08:47,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:08:47,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:08:47,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:08:47,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faccd8e18d38d4eb0024e7 HTTP/1.1" 200 None 2026-05-08 05:08:47,547 - lava_callback - ERROR - Error processing callback for node 69faccd8e18d38d4eb0024e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35956 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:10:08,018 - lava_callback - INFO - Received callback for node 69facd25e18d38d4eb00250e INFO: 172.20.0.1:35966 - "POST /node/69facd25e18d38d4eb00250e HTTP/1.0" 202 Accepted 2026-05-08 05:10:08,024 - lava_callback - INFO - Starting async job submit for node 69facd25e18d38d4eb00250e 2026-05-08 05:10:08,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:10:08,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facd25e18d38d4eb00250e HTTP/1.1" 200 None 2026-05-08 05:10:08,039 - lava_callback - DEBUG - Processing node 69facd25e18d38d4eb00250e: baseline-arm64-clabbe 2026-05-08 05:10:08,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facd25e18d38d4eb00250e 2026-05-08 05:10:08,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:10:08,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facd25e18d38d4eb00250e HTTP/1.1" 200 None 2026-05-08 05:10:08,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:10:08,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 05:10:08,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:10:08,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facd25e18d38d4eb00250e HTTP/1.1" 200 None 2026-05-08 05:10:08,091 - lava_callback - ERROR - Error processing callback for node 69facd25e18d38d4eb00250e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43656 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:11:27,624 - lava_callback - INFO - Received callback for node 69facd72e18d38d4eb002532 INFO: 172.20.0.1:43660 - "POST /node/69facd72e18d38d4eb002532 HTTP/1.0" 202 Accepted 2026-05-08 05:11:27,630 - lava_callback - INFO - Starting async job submit for node 69facd72e18d38d4eb002532 2026-05-08 05:11:27,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:11:27,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facd72e18d38d4eb002532 HTTP/1.1" 200 None 2026-05-08 05:11:27,648 - lava_callback - DEBUG - Processing node 69facd72e18d38d4eb002532: baseline-arm64-clabbe 2026-05-08 05:11:27,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facd72e18d38d4eb002532 2026-05-08 05:11:27,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:11:27,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facd72e18d38d4eb002532 HTTP/1.1" 200 None 2026-05-08 05:11:27,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:11:27,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:11:27,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:11:27,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facd72e18d38d4eb002532 HTTP/1.1" 200 None 2026-05-08 05:11:27,701 - lava_callback - ERROR - Error processing callback for node 69facd72e18d38d4eb002532: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33552 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:12:47,630 - lava_callback - INFO - Received callback for node 69facdbfe18d38d4eb00255d INFO: 172.20.0.1:33556 - "POST /node/69facdbfe18d38d4eb00255d HTTP/1.0" 202 Accepted 2026-05-08 05:12:47,635 - lava_callback - INFO - Starting async job submit for node 69facdbfe18d38d4eb00255d 2026-05-08 05:12:47,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:12:47,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facdbfe18d38d4eb00255d HTTP/1.1" 200 None 2026-05-08 05:12:47,672 - lava_callback - DEBUG - Processing node 69facdbfe18d38d4eb00255d: baseline-arm64-clabbe 2026-05-08 05:12:47,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facdbfe18d38d4eb00255d 2026-05-08 05:12:47,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:12:47,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facdbfe18d38d4eb00255d HTTP/1.1" 200 None 2026-05-08 05:12:47,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:12:47,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 05:12:47,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:12:47,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facdbfe18d38d4eb00255d HTTP/1.1" 200 None 2026-05-08 05:12:47,737 - lava_callback - ERROR - Error processing callback for node 69facdbfe18d38d4eb00255d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41380 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:14:07,602 - lava_callback - INFO - Received callback for node 69face0ce18d38d4eb002580 INFO: 172.20.0.1:41388 - "POST /node/69face0ce18d38d4eb002580 HTTP/1.0" 202 Accepted 2026-05-08 05:14:07,608 - lava_callback - INFO - Starting async job submit for node 69face0ce18d38d4eb002580 2026-05-08 05:14:07,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:14:07,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69face0ce18d38d4eb002580 HTTP/1.1" 200 None 2026-05-08 05:14:07,623 - lava_callback - DEBUG - Processing node 69face0ce18d38d4eb002580: baseline-arm64-clabbe 2026-05-08 05:14:07,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69face0ce18d38d4eb002580 2026-05-08 05:14:07,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:14:07,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69face0ce18d38d4eb002580 HTTP/1.1" 200 None 2026-05-08 05:14:07,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:14:07,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:14:07,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:14:07,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69face0ce18d38d4eb002580 HTTP/1.1" 200 None 2026-05-08 05:14:07,679 - lava_callback - ERROR - Error processing callback for node 69face0ce18d38d4eb002580: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:15:08,139 - lava_callback - INFO - Received callback for node 69face58e18d38d4eb0025a4 INFO: 172.20.0.1:49912 - "POST /node/69face58e18d38d4eb0025a4 HTTP/1.0" 202 Accepted 2026-05-08 05:15:08,145 - lava_callback - INFO - Starting async job submit for node 69face58e18d38d4eb0025a4 2026-05-08 05:15:08,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:15:08,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69face58e18d38d4eb0025a4 HTTP/1.1" 200 None 2026-05-08 05:15:08,172 - lava_callback - DEBUG - Processing node 69face58e18d38d4eb0025a4: baseline-arm64-clabbe 2026-05-08 05:15:08,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69face58e18d38d4eb0025a4 2026-05-08 05:15:08,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:15:08,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69face58e18d38d4eb0025a4 HTTP/1.1" 200 None 2026-05-08 05:15:08,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:15:08,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 05:15:08,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:15:08,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69face58e18d38d4eb0025a4 HTTP/1.1" 200 None 2026-05-08 05:15:08,231 - lava_callback - ERROR - Error processing callback for node 69face58e18d38d4eb0025a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51654 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:16:27,764 - lava_callback - INFO - Received callback for node 69facea4e18d38d4eb0025c9 INFO: 172.20.0.1:51662 - "POST /node/69facea4e18d38d4eb0025c9 HTTP/1.0" 202 Accepted 2026-05-08 05:16:27,770 - lava_callback - INFO - Starting async job submit for node 69facea4e18d38d4eb0025c9 2026-05-08 05:16:27,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:16:27,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facea4e18d38d4eb0025c9 HTTP/1.1" 200 None 2026-05-08 05:16:27,792 - lava_callback - DEBUG - Processing node 69facea4e18d38d4eb0025c9: baseline-arm64-clabbe 2026-05-08 05:16:27,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facea4e18d38d4eb0025c9 2026-05-08 05:16:27,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:16:27,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facea4e18d38d4eb0025c9 HTTP/1.1" 200 None 2026-05-08 05:16:27,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:16:27,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:16:27,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:16:27,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facea4e18d38d4eb0025c9 HTTP/1.1" 200 None 2026-05-08 05:16:27,867 - lava_callback - ERROR - Error processing callback for node 69facea4e18d38d4eb0025c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56094 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:17:47,755 - lava_callback - INFO - Received callback for node 69facef1e18d38d4eb0025f0 INFO: 172.20.0.1:56098 - "POST /node/69facef1e18d38d4eb0025f0 HTTP/1.0" 202 Accepted 2026-05-08 05:17:47,761 - lava_callback - INFO - Starting async job submit for node 69facef1e18d38d4eb0025f0 2026-05-08 05:17:47,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:17:47,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facef1e18d38d4eb0025f0 HTTP/1.1" 200 None 2026-05-08 05:17:47,776 - lava_callback - DEBUG - Processing node 69facef1e18d38d4eb0025f0: baseline-arm64-clabbe 2026-05-08 05:17:47,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facef1e18d38d4eb0025f0 2026-05-08 05:17:47,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:17:47,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facef1e18d38d4eb0025f0 HTTP/1.1" 200 None 2026-05-08 05:17:47,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:17:47,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 05:17:47,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:17:47,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facef1e18d38d4eb0025f0 HTTP/1.1" 200 None 2026-05-08 05:17:47,823 - lava_callback - ERROR - Error processing callback for node 69facef1e18d38d4eb0025f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:20:08,523 - lava_callback - INFO - Received callback for node 69facf7be18d38d4eb00262d INFO: 172.20.0.1:53602 - "POST /node/69facf7be18d38d4eb00262d HTTP/1.0" 202 Accepted 2026-05-08 05:20:08,529 - lava_callback - INFO - Starting async job submit for node 69facf7be18d38d4eb00262d 2026-05-08 05:20:08,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:20:08,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facf7be18d38d4eb00262d HTTP/1.1" 200 None 2026-05-08 05:20:08,552 - lava_callback - DEBUG - Processing node 69facf7be18d38d4eb00262d: baseline-arm-clabbe 2026-05-08 05:20:08,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facf7be18d38d4eb00262d 2026-05-08 05:20:08,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:20:08,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facf7be18d38d4eb00262d HTTP/1.1" 200 None 2026-05-08 05:20:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:20:08,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:20:08,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:20:08,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facf7be18d38d4eb00262d HTTP/1.1" 200 None 2026-05-08 05:20:08,603 - lava_callback - ERROR - Error processing callback for node 69facf7be18d38d4eb00262d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49494 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:20:47,869 - lava_callback - INFO - Received callback for node 69facfa2e18d38d4eb002639 INFO: 172.20.0.1:49510 - "POST /node/69facfa2e18d38d4eb002639 HTTP/1.0" 202 Accepted 2026-05-08 05:20:47,875 - lava_callback - INFO - Starting async job submit for node 69facfa2e18d38d4eb002639 2026-05-08 05:20:47,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:20:47,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facfa2e18d38d4eb002639 HTTP/1.1" 200 None 2026-05-08 05:20:47,889 - lava_callback - DEBUG - Processing node 69facfa2e18d38d4eb002639: baseline-arm-clabbe 2026-05-08 05:20:47,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facfa2e18d38d4eb002639 2026-05-08 05:20:47,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:20:47,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facfa2e18d38d4eb002639 HTTP/1.1" 200 None 2026-05-08 05:20:47,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:20:47,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:20:47,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:20:47,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facfa2e18d38d4eb002639 HTTP/1.1" 200 None 2026-05-08 05:20:47,941 - lava_callback - ERROR - Error processing callback for node 69facfa2e18d38d4eb002639: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35890 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:22:07,913 - lava_callback - INFO - Received callback for node 69facfebe18d38d4eb00264d INFO: 172.20.0.1:35900 - "POST /node/69facfebe18d38d4eb00264d HTTP/1.0" 202 Accepted 2026-05-08 05:22:07,918 - lava_callback - INFO - Starting async job submit for node 69facfebe18d38d4eb00264d 2026-05-08 05:22:07,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:22:07,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facfebe18d38d4eb00264d HTTP/1.1" 200 None 2026-05-08 05:22:07,939 - lava_callback - DEBUG - Processing node 69facfebe18d38d4eb00264d: baseline-arm-clabbe 2026-05-08 05:22:07,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69facfebe18d38d4eb00264d 2026-05-08 05:22:07,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:22:07,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69facfebe18d38d4eb00264d HTTP/1.1" 200 None 2026-05-08 05:22:07,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:22:07,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:22:07,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:22:08,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69facfebe18d38d4eb00264d HTTP/1.1" 200 None 2026-05-08 05:22:08,017 - lava_callback - ERROR - Error processing callback for node 69facfebe18d38d4eb00264d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48528 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:22:35,129 - lava_callback - INFO - Received callback for node 69fad00be18d38d4eb00265b INFO: 172.20.0.1:55832 - "POST /node/69fad00be18d38d4eb00265b HTTP/1.0" 202 Accepted 2026-05-08 05:22:35,134 - lava_callback - INFO - Starting async job submit for node 69fad00be18d38d4eb00265b 2026-05-08 05:22:35,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:22:35,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad00be18d38d4eb00265b HTTP/1.1" 200 None 2026-05-08 05:22:35,157 - lava_callback - DEBUG - Processing node 69fad00be18d38d4eb00265b: baseline-arm-baylibre 2026-05-08 05:22:35,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad00be18d38d4eb00265b 2026-05-08 05:22:35,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:22:35,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad00be18d38d4eb00265b HTTP/1.1" 200 None 2026-05-08 05:22:35,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:22:35,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:22:35,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:22:35,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad00be18d38d4eb00265b HTTP/1.1" 200 None 2026-05-08 05:22:35,202 - lava_callback - ERROR - Error processing callback for node 69fad00be18d38d4eb00265b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54324 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:23:14,968 - lava_callback - INFO - Received callback for node 69fad031e18d38d4eb002668 INFO: 172.20.0.1:46270 - "POST /node/69fad031e18d38d4eb002668 HTTP/1.0" 202 Accepted 2026-05-08 05:23:14,974 - lava_callback - INFO - Starting async job submit for node 69fad031e18d38d4eb002668 2026-05-08 05:23:14,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:23:14,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad031e18d38d4eb002668 HTTP/1.1" 200 None 2026-05-08 05:23:14,990 - lava_callback - DEBUG - Processing node 69fad031e18d38d4eb002668: baseline-arm-baylibre 2026-05-08 05:23:14,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad031e18d38d4eb002668 2026-05-08 05:23:14,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:23:15,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad031e18d38d4eb002668 HTTP/1.1" 200 None 2026-05-08 05:23:15,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:23:15,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:23:15,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:23:15,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad031e18d38d4eb002668 HTTP/1.1" 200 None 2026-05-08 05:23:15,045 - lava_callback - ERROR - Error processing callback for node 69fad031e18d38d4eb002668: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59558 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:23:48,040 - lava_callback - INFO - Received callback for node 69fad05ae18d38d4eb002676 INFO: 172.20.0.1:59570 - "POST /node/69fad05ae18d38d4eb002676 HTTP/1.0" 202 Accepted 2026-05-08 05:23:48,046 - lava_callback - INFO - Starting async job submit for node 69fad05ae18d38d4eb002676 2026-05-08 05:23:48,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:23:48,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad05ae18d38d4eb002676 HTTP/1.1" 200 None 2026-05-08 05:23:48,064 - lava_callback - DEBUG - Processing node 69fad05ae18d38d4eb002676: baseline-arm-clabbe 2026-05-08 05:23:48,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad05ae18d38d4eb002676 2026-05-08 05:23:48,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:23:48,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad05ae18d38d4eb002676 HTTP/1.1" 200 None 2026-05-08 05:23:48,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:23:48,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:23:48,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:23:48,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad05ae18d38d4eb002676 HTTP/1.1" 200 None 2026-05-08 05:23:48,115 - lava_callback - ERROR - Error processing callback for node 69fad05ae18d38d4eb002676: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51536 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:24:28,033 - lava_callback - INFO - Received callback for node 69fad07fe18d38d4eb002681 INFO: 172.20.0.1:51552 - "POST /node/69fad07fe18d38d4eb002681 HTTP/1.0" 202 Accepted 2026-05-08 05:24:28,039 - lava_callback - INFO - Starting async job submit for node 69fad07fe18d38d4eb002681 2026-05-08 05:24:28,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:24:28,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad07fe18d38d4eb002681 HTTP/1.1" 200 None 2026-05-08 05:24:28,054 - lava_callback - DEBUG - Processing node 69fad07fe18d38d4eb002681: baseline-arm-clabbe 2026-05-08 05:24:28,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad07fe18d38d4eb002681 2026-05-08 05:24:28,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:24:28,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad07fe18d38d4eb002681 HTTP/1.1" 200 None 2026-05-08 05:24:28,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:24:28,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:24:28,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:24:28,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad07fe18d38d4eb002681 HTTP/1.1" 200 None 2026-05-08 05:24:28,100 - lava_callback - ERROR - Error processing callback for node 69fad07fe18d38d4eb002681: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42728 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:24:55,071 - lava_callback - INFO - Received callback for node 69fad0a0e18d38d4eb00268c INFO: 172.20.0.1:48762 - "POST /node/69fad0a0e18d38d4eb00268c HTTP/1.0" 202 Accepted 2026-05-08 05:24:55,077 - lava_callback - INFO - Starting async job submit for node 69fad0a0e18d38d4eb00268c 2026-05-08 05:24:55,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:24:55,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad0a0e18d38d4eb00268c HTTP/1.1" 200 None 2026-05-08 05:24:55,092 - lava_callback - DEBUG - Processing node 69fad0a0e18d38d4eb00268c: baseline-arm-baylibre 2026-05-08 05:24:55,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad0a0e18d38d4eb00268c 2026-05-08 05:24:55,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:24:55,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad0a0e18d38d4eb00268c HTTP/1.1" 200 None 2026-05-08 05:24:55,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:24:55,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:24:55,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:24:55,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad0a0e18d38d4eb00268c HTTP/1.1" 200 None 2026-05-08 05:24:55,142 - lava_callback - ERROR - Error processing callback for node 69fad0a0e18d38d4eb00268c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46650 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:25:35,105 - lava_callback - INFO - Received callback for node 69fad0c6e18d38d4eb00269e INFO: 172.20.0.1:40320 - "POST /node/69fad0c6e18d38d4eb00269e HTTP/1.0" 202 Accepted 2026-05-08 05:25:35,110 - lava_callback - INFO - Starting async job submit for node 69fad0c6e18d38d4eb00269e 2026-05-08 05:25:35,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:25:35,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad0c6e18d38d4eb00269e HTTP/1.1" 200 None 2026-05-08 05:25:35,125 - lava_callback - DEBUG - Processing node 69fad0c6e18d38d4eb00269e: baseline-arm-baylibre 2026-05-08 05:25:35,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad0c6e18d38d4eb00269e 2026-05-08 05:25:35,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:25:35,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad0c6e18d38d4eb00269e HTTP/1.1" 200 None 2026-05-08 05:25:35,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:25:35,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:25:35,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:25:35,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad0c6e18d38d4eb00269e HTTP/1.1" 200 None 2026-05-08 05:25:35,176 - lava_callback - ERROR - Error processing callback for node 69fad0c6e18d38d4eb00269e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44246 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:26:15,153 - lava_callback - INFO - Received callback for node 69fad0ece18d38d4eb0026a6 INFO: 172.20.0.1:58920 - "POST /node/69fad0ece18d38d4eb0026a6 HTTP/1.0" 202 Accepted 2026-05-08 05:26:15,159 - lava_callback - INFO - Starting async job submit for node 69fad0ece18d38d4eb0026a6 2026-05-08 05:26:15,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:58932 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 05:26:15,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad0ece18d38d4eb0026a6 HTTP/1.1" 200 None 2026-05-08 05:26:15,174 - lava_callback - DEBUG - Processing node 69fad0ece18d38d4eb0026a6: baseline-arm-baylibre 2026-05-08 05:26:15,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad0ece18d38d4eb0026a6 2026-05-08 05:26:15,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:26:15,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad0ece18d38d4eb0026a6 HTTP/1.1" 200 None 2026-05-08 05:26:15,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:26:15,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:26:15,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:26:15,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad0ece18d38d4eb0026a6 HTTP/1.1" 200 None 2026-05-08 05:26:15,232 - lava_callback - ERROR - Error processing callback for node 69fad0ece18d38d4eb0026a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:28:08,208 - lava_callback - INFO - Received callback for node 69fad15de18d38d4eb0026d0 INFO: 172.20.0.1:50566 - "POST /node/69fad15de18d38d4eb0026d0 HTTP/1.0" 202 Accepted 2026-05-08 05:28:08,213 - lava_callback - INFO - Starting async job submit for node 69fad15de18d38d4eb0026d0 2026-05-08 05:28:08,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:28:08,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad15de18d38d4eb0026d0 HTTP/1.1" 200 None 2026-05-08 05:28:08,237 - lava_callback - DEBUG - Processing node 69fad15de18d38d4eb0026d0: baseline-arm-clabbe 2026-05-08 05:28:08,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad15de18d38d4eb0026d0 2026-05-08 05:28:08,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:28:08,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad15de18d38d4eb0026d0 HTTP/1.1" 200 None 2026-05-08 05:28:08,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:28:08,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:28:08,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:28:08,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad15de18d38d4eb0026d0 HTTP/1.1" 200 None 2026-05-08 05:28:08,287 - lava_callback - ERROR - Error processing callback for node 69fad15de18d38d4eb0026d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:28:48,215 - lava_callback - INFO - Received callback for node 69fad183e18d38d4eb0026db INFO: 172.20.0.1:53704 - "POST /node/69fad183e18d38d4eb0026db HTTP/1.0" 202 Accepted 2026-05-08 05:28:48,222 - lava_callback - INFO - Starting async job submit for node 69fad183e18d38d4eb0026db 2026-05-08 05:28:48,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:28:48,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad183e18d38d4eb0026db HTTP/1.1" 200 None 2026-05-08 05:28:48,251 - lava_callback - DEBUG - Processing node 69fad183e18d38d4eb0026db: baseline-arm-clabbe 2026-05-08 05:28:48,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad183e18d38d4eb0026db 2026-05-08 05:28:48,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:28:48,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad183e18d38d4eb0026db HTTP/1.1" 200 None 2026-05-08 05:28:48,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:28:48,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:28:48,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:28:48,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad183e18d38d4eb0026db HTTP/1.1" 200 None 2026-05-08 05:28:48,298 - lava_callback - ERROR - Error processing callback for node 69fad183e18d38d4eb0026db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44688 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:29:28,250 - lava_callback - INFO - Received callback for node 69fad1a9e18d38d4eb0026e6 INFO: 172.20.0.1:44690 - "POST /node/69fad1a9e18d38d4eb0026e6 HTTP/1.0" 202 Accepted 2026-05-08 05:29:28,256 - lava_callback - INFO - Starting async job submit for node 69fad1a9e18d38d4eb0026e6 2026-05-08 05:29:28,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:29:28,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad1a9e18d38d4eb0026e6 HTTP/1.1" 200 None 2026-05-08 05:29:28,270 - lava_callback - DEBUG - Processing node 69fad1a9e18d38d4eb0026e6: baseline-arm-clabbe 2026-05-08 05:29:28,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad1a9e18d38d4eb0026e6 2026-05-08 05:29:28,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:29:28,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad1a9e18d38d4eb0026e6 HTTP/1.1" 200 None 2026-05-08 05:29:28,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:29:28,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:29:28,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:29:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad1a9e18d38d4eb0026e6 HTTP/1.1" 200 None 2026-05-08 05:29:28,331 - lava_callback - ERROR - Error processing callback for node 69fad1a9e18d38d4eb0026e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59192 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:30:08,225 - lava_callback - INFO - Received callback for node 69fad1cee18d38d4eb0026f1 INFO: 172.20.0.1:59208 - "POST /node/69fad1cee18d38d4eb0026f1 HTTP/1.0" 202 Accepted 2026-05-08 05:30:08,231 - lava_callback - INFO - Starting async job submit for node 69fad1cee18d38d4eb0026f1 2026-05-08 05:30:08,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:30:08,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad1cee18d38d4eb0026f1 HTTP/1.1" 200 None 2026-05-08 05:30:08,252 - lava_callback - DEBUG - Processing node 69fad1cee18d38d4eb0026f1: baseline-arm-clabbe 2026-05-08 05:30:08,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad1cee18d38d4eb0026f1 2026-05-08 05:30:08,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:30:08,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad1cee18d38d4eb0026f1 HTTP/1.1" 200 None 2026-05-08 05:30:08,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:30:08,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:30:08,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:30:08,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad1cee18d38d4eb0026f1 HTTP/1.1" 200 None 2026-05-08 05:30:08,330 - lava_callback - ERROR - Error processing callback for node 69fad1cee18d38d4eb0026f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40332 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:30:48,325 - lava_callback - INFO - Received callback for node 69fad1f4e18d38d4eb002702 INFO: 172.20.0.1:40336 - "POST /node/69fad1f4e18d38d4eb002702 HTTP/1.0" 202 Accepted 2026-05-08 05:30:48,334 - lava_callback - INFO - Starting async job submit for node 69fad1f4e18d38d4eb002702 2026-05-08 05:30:48,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:30:48,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad1f4e18d38d4eb002702 HTTP/1.1" 200 None 2026-05-08 05:30:48,353 - lava_callback - DEBUG - Processing node 69fad1f4e18d38d4eb002702: baseline-arm-clabbe 2026-05-08 05:30:48,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad1f4e18d38d4eb002702 2026-05-08 05:30:48,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:30:48,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad1f4e18d38d4eb002702 HTTP/1.1" 200 None 2026-05-08 05:30:48,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:30:48,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:30:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:30:48,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad1f4e18d38d4eb002702 HTTP/1.1" 200 None 2026-05-08 05:30:48,407 - lava_callback - ERROR - Error processing callback for node 69fad1f4e18d38d4eb002702: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56970 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:31:28,360 - lava_callback - INFO - Received callback for node 69fad21ae18d38d4eb00270a INFO: 172.20.0.1:56974 - "POST /node/69fad21ae18d38d4eb00270a HTTP/1.0" 202 Accepted 2026-05-08 05:31:28,365 - lava_callback - INFO - Starting async job submit for node 69fad21ae18d38d4eb00270a 2026-05-08 05:31:28,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:31:28,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad21ae18d38d4eb00270a HTTP/1.1" 200 None 2026-05-08 05:31:28,379 - lava_callback - DEBUG - Processing node 69fad21ae18d38d4eb00270a: baseline-arm-clabbe 2026-05-08 05:31:28,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad21ae18d38d4eb00270a 2026-05-08 05:31:28,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:31:28,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad21ae18d38d4eb00270a HTTP/1.1" 200 None 2026-05-08 05:31:28,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:31:28,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 05:31:28,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:31:28,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad21ae18d38d4eb00270a HTTP/1.1" 200 None 2026-05-08 05:31:28,425 - lava_callback - ERROR - Error processing callback for node 69fad21ae18d38d4eb00270a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56598 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:31:55,519 - lava_callback - INFO - Received callback for node 69fad246e18d38d4eb002718 INFO: 172.20.0.1:52434 - "POST /node/69fad246e18d38d4eb002718 HTTP/1.0" 202 Accepted 2026-05-08 05:31:55,525 - lava_callback - INFO - Starting async job submit for node 69fad246e18d38d4eb002718 2026-05-08 05:31:55,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:31:55,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad246e18d38d4eb002718 HTTP/1.1" 200 None 2026-05-08 05:31:55,541 - lava_callback - DEBUG - Processing node 69fad246e18d38d4eb002718: baseline-arm64-baylibre 2026-05-08 05:31:55,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad246e18d38d4eb002718 2026-05-08 05:31:55,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:31:55,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad246e18d38d4eb002718 HTTP/1.1" 200 None 2026-05-08 05:31:55,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:31:55,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:31:55,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:31:55,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad246e18d38d4eb002718 HTTP/1.1" 200 None 2026-05-08 05:31:55,589 - lava_callback - ERROR - Error processing callback for node 69fad246e18d38d4eb002718: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54578 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 05:33:15,515 - lava_callback - INFO - Received callback for node 69fad292e18d38d4eb00273a INFO: 172.20.0.1:54584 - "POST /node/69fad292e18d38d4eb00273a HTTP/1.0" 202 Accepted 2026-05-08 05:33:15,521 - lava_callback - INFO - Starting async job submit for node 69fad292e18d38d4eb00273a 2026-05-08 05:33:15,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:33:15,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad292e18d38d4eb00273a HTTP/1.1" 200 None 2026-05-08 05:33:15,537 - lava_callback - DEBUG - Processing node 69fad292e18d38d4eb00273a: baseline-arm64-baylibre 2026-05-08 05:33:15,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad292e18d38d4eb00273a 2026-05-08 05:33:15,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:33:15,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad292e18d38d4eb00273a HTTP/1.1" 200 None 2026-05-08 05:33:15,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:33:15,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:33:15,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:33:15,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad292e18d38d4eb00273a HTTP/1.1" 200 None 2026-05-08 05:33:15,589 - lava_callback - ERROR - Error processing callback for node 69fad292e18d38d4eb00273a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37812 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:34:48,476 - lava_callback - INFO - Received callback for node 69fad2e3e18d38d4eb002763 INFO: 172.20.0.1:37822 - "POST /node/69fad2e3e18d38d4eb002763 HTTP/1.0" 202 Accepted 2026-05-08 05:34:48,482 - lava_callback - INFO - Starting async job submit for node 69fad2e3e18d38d4eb002763 2026-05-08 05:34:48,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:34:48,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad2e3e18d38d4eb002763 HTTP/1.1" 200 None 2026-05-08 05:34:48,496 - lava_callback - DEBUG - Processing node 69fad2e3e18d38d4eb002763: baseline-arm64-clabbe 2026-05-08 05:34:48,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad2e3e18d38d4eb002763 2026-05-08 05:34:48,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:34:48,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad2e3e18d38d4eb002763 HTTP/1.1" 200 None 2026-05-08 05:34:48,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:34:48,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:34:48,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:34:48,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad2e3e18d38d4eb002763 HTTP/1.1" 200 None 2026-05-08 05:34:48,544 - lava_callback - ERROR - Error processing callback for node 69fad2e3e18d38d4eb002763: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48578 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:35:55,840 - lava_callback - INFO - Received callback for node 69fad329e18d38d4eb00277e INFO: 172.20.0.1:54038 - "POST /node/69fad329e18d38d4eb00277e HTTP/1.0" 202 Accepted 2026-05-08 05:35:55,849 - lava_callback - INFO - Starting async job submit for node 69fad329e18d38d4eb00277e 2026-05-08 05:35:55,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:35:55,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad329e18d38d4eb00277e HTTP/1.1" 200 None 2026-05-08 05:35:55,866 - lava_callback - DEBUG - Processing node 69fad329e18d38d4eb00277e: baseline-arm64-baylibre 2026-05-08 05:35:55,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad329e18d38d4eb00277e 2026-05-08 05:35:55,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:35:55,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad329e18d38d4eb00277e HTTP/1.1" 200 None 2026-05-08 05:35:55,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:35:55,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:35:55,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:35:55,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad329e18d38d4eb00277e HTTP/1.1" 200 None 2026-05-08 05:35:55,919 - lava_callback - ERROR - Error processing callback for node 69fad329e18d38d4eb00277e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36922 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:37:08,536 - lava_callback - INFO - Received callback for node 69fad37be18d38d4eb0027a2 INFO: 172.20.0.1:36934 - "POST /node/69fad37be18d38d4eb0027a2 HTTP/1.0" 202 Accepted 2026-05-08 05:37:08,542 - lava_callback - INFO - Starting async job submit for node 69fad37be18d38d4eb0027a2 2026-05-08 05:37:08,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:37:08,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad37be18d38d4eb0027a2 HTTP/1.1" 200 None 2026-05-08 05:37:08,556 - lava_callback - DEBUG - Processing node 69fad37be18d38d4eb0027a2: baseline-arm64-clabbe 2026-05-08 05:37:08,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad37be18d38d4eb0027a2 2026-05-08 05:37:08,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:37:08,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad37be18d38d4eb0027a2 HTTP/1.1" 200 None 2026-05-08 05:37:08,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:37:08,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:37:08,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:37:08,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad37be18d38d4eb0027a2 HTTP/1.1" 200 None 2026-05-08 05:37:08,622 - lava_callback - ERROR - Error processing callback for node 69fad37be18d38d4eb0027a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42400 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 05:38:15,782 - lava_callback - INFO - Received callback for node 69fad3c0e18d38d4eb0027bd INFO: 172.20.0.1:42406 - "POST /node/69fad3c0e18d38d4eb0027bd HTTP/1.0" 202 Accepted 2026-05-08 05:38:15,788 - lava_callback - INFO - Starting async job submit for node 69fad3c0e18d38d4eb0027bd 2026-05-08 05:38:15,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:38:15,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad3c0e18d38d4eb0027bd HTTP/1.1" 200 None 2026-05-08 05:38:15,803 - lava_callback - DEBUG - Processing node 69fad3c0e18d38d4eb0027bd: baseline-arm64-baylibre 2026-05-08 05:38:15,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad3c0e18d38d4eb0027bd 2026-05-08 05:38:15,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:38:15,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad3c0e18d38d4eb0027bd HTTP/1.1" 200 None 2026-05-08 05:38:15,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:38:15,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:38:15,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:38:15,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad3c0e18d38d4eb0027bd HTTP/1.1" 200 None 2026-05-08 05:38:15,858 - lava_callback - ERROR - Error processing callback for node 69fad3c0e18d38d4eb0027bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:39:48,632 - lava_callback - INFO - Received callback for node 69fad410e18d38d4eb0027e7 INFO: 172.20.0.1:36664 - "POST /node/69fad410e18d38d4eb0027e7 HTTP/1.0" 202 Accepted 2026-05-08 05:39:48,638 - lava_callback - INFO - Starting async job submit for node 69fad410e18d38d4eb0027e7 2026-05-08 05:39:48,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:39:48,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad410e18d38d4eb0027e7 HTTP/1.1" 200 None 2026-05-08 05:39:48,652 - lava_callback - DEBUG - Processing node 69fad410e18d38d4eb0027e7: baseline-arm64-clabbe 2026-05-08 05:39:48,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad410e18d38d4eb0027e7 2026-05-08 05:39:48,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:39:48,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad410e18d38d4eb0027e7 HTTP/1.1" 200 None 2026-05-08 05:39:48,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:39:48,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:39:48,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:39:48,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad410e18d38d4eb0027e7 HTTP/1.1" 200 None 2026-05-08 05:39:48,720 - lava_callback - ERROR - Error processing callback for node 69fad410e18d38d4eb0027e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35750 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:40:48,686 - lava_callback - INFO - Received callback for node 69fad45ae18d38d4eb002806 INFO: 172.20.0.1:35758 - "POST /node/69fad45ae18d38d4eb002806 HTTP/1.0" 202 Accepted 2026-05-08 05:40:48,692 - lava_callback - INFO - Starting async job submit for node 69fad45ae18d38d4eb002806 2026-05-08 05:40:48,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:40:48,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad45ae18d38d4eb002806 HTTP/1.1" 200 None 2026-05-08 05:40:48,707 - lava_callback - DEBUG - Processing node 69fad45ae18d38d4eb002806: baseline-arm64-clabbe 2026-05-08 05:40:48,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad45ae18d38d4eb002806 2026-05-08 05:40:48,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:40:48,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad45ae18d38d4eb002806 HTTP/1.1" 200 None 2026-05-08 05:40:48,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:40:48,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:40:48,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:40:48,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad45ae18d38d4eb002806 HTTP/1.1" 200 None 2026-05-08 05:40:48,765 - lava_callback - ERROR - Error processing callback for node 69fad45ae18d38d4eb002806: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45612 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:42:08,728 - lava_callback - INFO - Received callback for node 69fad4a7e18d38d4eb00282c INFO: 172.20.0.1:45628 - "POST /node/69fad4a7e18d38d4eb00282c HTTP/1.0" 202 Accepted 2026-05-08 05:42:08,733 - lava_callback - INFO - Starting async job submit for node 69fad4a7e18d38d4eb00282c 2026-05-08 05:42:08,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:42:08,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad4a7e18d38d4eb00282c HTTP/1.1" 200 None 2026-05-08 05:42:08,748 - lava_callback - DEBUG - Processing node 69fad4a7e18d38d4eb00282c: baseline-arm64-clabbe 2026-05-08 05:42:08,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad4a7e18d38d4eb00282c 2026-05-08 05:42:08,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:42:08,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad4a7e18d38d4eb00282c HTTP/1.1" 200 None 2026-05-08 05:42:08,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:42:08,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:42:08,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:42:08,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad4a7e18d38d4eb00282c HTTP/1.1" 200 None 2026-05-08 05:42:08,793 - lava_callback - ERROR - Error processing callback for node 69fad4a7e18d38d4eb00282c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46856 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:43:28,817 - lava_callback - INFO - Received callback for node 69fad4f4e18d38d4eb00284c INFO: 172.20.0.1:46860 - "POST /node/69fad4f4e18d38d4eb00284c HTTP/1.0" 202 Accepted 2026-05-08 05:43:28,823 - lava_callback - INFO - Starting async job submit for node 69fad4f4e18d38d4eb00284c 2026-05-08 05:43:28,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:43:28,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad4f4e18d38d4eb00284c HTTP/1.1" 200 None 2026-05-08 05:43:28,838 - lava_callback - DEBUG - Processing node 69fad4f4e18d38d4eb00284c: baseline-arm64-clabbe 2026-05-08 05:43:28,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad4f4e18d38d4eb00284c 2026-05-08 05:43:28,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:43:28,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad4f4e18d38d4eb00284c HTTP/1.1" 200 None 2026-05-08 05:43:28,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:43:28,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:43:28,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:43:28,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad4f4e18d38d4eb00284c HTTP/1.1" 200 None 2026-05-08 05:43:28,893 - lava_callback - ERROR - Error processing callback for node 69fad4f4e18d38d4eb00284c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48222 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:44:48,886 - lava_callback - INFO - Received callback for node 69fad53ee18d38d4eb002876 INFO: 172.20.0.1:48228 - "POST /node/69fad53ee18d38d4eb002876 HTTP/1.0" 202 Accepted 2026-05-08 05:44:48,895 - lava_callback - INFO - Starting async job submit for node 69fad53ee18d38d4eb002876 2026-05-08 05:44:48,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:44:48,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad53ee18d38d4eb002876 HTTP/1.1" 200 None 2026-05-08 05:44:48,912 - lava_callback - DEBUG - Processing node 69fad53ee18d38d4eb002876: baseline-arm64-clabbe 2026-05-08 05:44:48,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad53ee18d38d4eb002876 2026-05-08 05:44:48,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:44:48,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad53ee18d38d4eb002876 HTTP/1.1" 200 None 2026-05-08 05:44:48,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:44:48,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:44:48,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:44:48,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad53ee18d38d4eb002876 HTTP/1.1" 200 None 2026-05-08 05:44:48,968 - lava_callback - ERROR - Error processing callback for node 69fad53ee18d38d4eb002876: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55834 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:45:49,821 - lava_callback - INFO - Received callback for node 69fad58ae18d38d4eb002891 INFO: 172.20.0.1:43418 - "POST /node/69fad58ae18d38d4eb002891 HTTP/1.0" 202 Accepted 2026-05-08 05:45:49,830 - lava_callback - INFO - Starting async job submit for node 69fad58ae18d38d4eb002891 2026-05-08 05:45:49,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:45:49,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad58ae18d38d4eb002891 HTTP/1.1" 200 None 2026-05-08 05:45:49,844 - lava_callback - DEBUG - Processing node 69fad58ae18d38d4eb002891: baseline-arm64-clabbe 2026-05-08 05:45:49,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad58ae18d38d4eb002891 2026-05-08 05:45:49,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:45:49,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad58ae18d38d4eb002891 HTTP/1.1" 200 None 2026-05-08 05:45:49,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:45:49,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:45:49,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:45:49,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad58ae18d38d4eb002891 HTTP/1.1" 200 None 2026-05-08 05:45:49,912 - lava_callback - ERROR - Error processing callback for node 69fad58ae18d38d4eb002891: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45734 - "GET /node/699438a85ae459b9df3d4bf4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45746 - "GET /node/69e681bbdc041e577b77b945%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:47:08,854 - lava_callback - INFO - Received callback for node 69fad5c8e18d38d4eb0028af INFO: 172.20.0.1:36840 - "POST /node/69fad5c8e18d38d4eb0028af HTTP/1.0" 202 Accepted 2026-05-08 05:47:08,859 - lava_callback - INFO - Starting async job submit for node 69fad5c8e18d38d4eb0028af 2026-05-08 05:47:08,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:47:08,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad5c8e18d38d4eb0028af HTTP/1.1" 200 None 2026-05-08 05:47:08,875 - lava_callback - DEBUG - Processing node 69fad5c8e18d38d4eb0028af: baseline-arm-clabbe 2026-05-08 05:47:08,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad5c8e18d38d4eb0028af 2026-05-08 05:47:08,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:47:08,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad5c8e18d38d4eb0028af HTTP/1.1" 200 None 2026-05-08 05:47:08,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:47:08,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:47:08,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:47:08,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad5c8e18d38d4eb0028af HTTP/1.1" 200 None 2026-05-08 05:47:08,933 - lava_callback - ERROR - Error processing callback for node 69fad5c8e18d38d4eb0028af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34152 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:47:48,888 - lava_callback - INFO - Received callback for node 69fad5eee18d38d4eb0028c2 INFO: 172.20.0.1:34168 - "POST /node/69fad5eee18d38d4eb0028c2 HTTP/1.0" 202 Accepted 2026-05-08 05:47:48,894 - lava_callback - INFO - Starting async job submit for node 69fad5eee18d38d4eb0028c2 2026-05-08 05:47:48,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:47:48,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad5eee18d38d4eb0028c2 HTTP/1.1" 200 None 2026-05-08 05:47:48,909 - lava_callback - DEBUG - Processing node 69fad5eee18d38d4eb0028c2: baseline-arm-clabbe 2026-05-08 05:47:48,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad5eee18d38d4eb0028c2 2026-05-08 05:47:48,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:47:48,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad5eee18d38d4eb0028c2 HTTP/1.1" 200 None 2026-05-08 05:47:48,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:47:48,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:47:48,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:47:48,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad5eee18d38d4eb0028c2 HTTP/1.1" 200 None 2026-05-08 05:47:48,958 - lava_callback - ERROR - Error processing callback for node 69fad5eee18d38d4eb0028c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42134 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:48:28,972 - lava_callback - INFO - Received callback for node 69fad622e18d38d4eb0028d0 INFO: 172.20.0.1:42146 - "POST /node/69fad622e18d38d4eb0028d0 HTTP/1.0" 202 Accepted 2026-05-08 05:48:28,977 - lava_callback - INFO - Starting async job submit for node 69fad622e18d38d4eb0028d0 2026-05-08 05:48:28,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:48:28,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad622e18d38d4eb0028d0 HTTP/1.1" 200 None 2026-05-08 05:48:28,997 - lava_callback - DEBUG - Processing node 69fad622e18d38d4eb0028d0: baseline-arm64-clabbe 2026-05-08 05:48:28,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad622e18d38d4eb0028d0 2026-05-08 05:48:28,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:48:29,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad622e18d38d4eb0028d0 HTTP/1.1" 200 None 2026-05-08 05:48:29,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:48:29,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:48:29,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:48:29,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad622e18d38d4eb0028d0 HTTP/1.1" 200 None 2026-05-08 05:48:29,042 - lava_callback - ERROR - Error processing callback for node 69fad622e18d38d4eb0028d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53698 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:49:29,037 - lava_callback - INFO - Received callback for node 69fad65fe18d38d4eb0028ef INFO: 172.20.0.1:53710 - "POST /node/69fad65fe18d38d4eb0028ef HTTP/1.0" 202 Accepted 2026-05-08 05:49:29,042 - lava_callback - INFO - Starting async job submit for node 69fad65fe18d38d4eb0028ef 2026-05-08 05:49:29,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:49:29,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad65fe18d38d4eb0028ef HTTP/1.1" 200 None 2026-05-08 05:49:29,057 - lava_callback - DEBUG - Processing node 69fad65fe18d38d4eb0028ef: baseline-arm-clabbe 2026-05-08 05:49:29,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad65fe18d38d4eb0028ef 2026-05-08 05:49:29,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:49:29,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad65fe18d38d4eb0028ef HTTP/1.1" 200 None 2026-05-08 05:49:29,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:49:29,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:49:29,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:49:29,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad65fe18d38d4eb0028ef HTTP/1.1" 200 None 2026-05-08 05:49:29,105 - lava_callback - ERROR - Error processing callback for node 69fad65fe18d38d4eb0028ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59386 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:50:29,014 - lava_callback - INFO - Received callback for node 69fad692e18d38d4eb0028fe INFO: 172.20.0.1:59388 - "POST /node/69fad692e18d38d4eb0028fe HTTP/1.0" 202 Accepted 2026-05-08 05:50:29,020 - lava_callback - INFO - Starting async job submit for node 69fad692e18d38d4eb0028fe 2026-05-08 05:50:29,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:50:29,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad692e18d38d4eb0028fe HTTP/1.1" 200 None 2026-05-08 05:50:29,035 - lava_callback - DEBUG - Processing node 69fad692e18d38d4eb0028fe: baseline-arm64-clabbe 2026-05-08 05:50:29,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad692e18d38d4eb0028fe 2026-05-08 05:50:29,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:50:29,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad692e18d38d4eb0028fe HTTP/1.1" 200 None 2026-05-08 05:50:29,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:50:29,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:50:29,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:50:29,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad692e18d38d4eb0028fe HTTP/1.1" 200 None 2026-05-08 05:50:29,101 - lava_callback - ERROR - Error processing callback for node 69fad692e18d38d4eb0028fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55488 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:51:29,300 - lava_callback - INFO - Received callback for node 69fad6d0e18d38d4eb002923 INFO: 172.20.0.1:55496 - "POST /node/69fad6d0e18d38d4eb002923 HTTP/1.0" 202 Accepted 2026-05-08 05:51:29,306 - lava_callback - INFO - Starting async job submit for node 69fad6d0e18d38d4eb002923 2026-05-08 05:51:29,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:51:29,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad6d0e18d38d4eb002923 HTTP/1.1" 200 None 2026-05-08 05:51:29,323 - lava_callback - DEBUG - Processing node 69fad6d0e18d38d4eb002923: baseline-arm-clabbe 2026-05-08 05:51:29,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad6d0e18d38d4eb002923 2026-05-08 05:51:29,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:51:29,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad6d0e18d38d4eb002923 HTTP/1.1" 200 None 2026-05-08 05:51:29,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:51:29,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:51:29,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:51:29,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad6d0e18d38d4eb002923 HTTP/1.1" 200 None 2026-05-08 05:51:29,375 - lava_callback - ERROR - Error processing callback for node 69fad6d0e18d38d4eb002923: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41346 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:52:09,134 - lava_callback - INFO - Received callback for node 69fad6f6e18d38d4eb00292f INFO: 172.20.0.1:41354 - "POST /node/69fad6f6e18d38d4eb00292f HTTP/1.0" 202 Accepted 2026-05-08 05:52:09,140 - lava_callback - INFO - Starting async job submit for node 69fad6f6e18d38d4eb00292f 2026-05-08 05:52:09,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:52:09,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad6f6e18d38d4eb00292f HTTP/1.1" 200 None 2026-05-08 05:52:09,157 - lava_callback - DEBUG - Processing node 69fad6f6e18d38d4eb00292f: baseline-arm-clabbe 2026-05-08 05:52:09,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad6f6e18d38d4eb00292f 2026-05-08 05:52:09,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:52:09,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad6f6e18d38d4eb00292f HTTP/1.1" 200 None 2026-05-08 05:52:09,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:52:09,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:52:09,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:52:09,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad6f6e18d38d4eb00292f HTTP/1.1" 200 None 2026-05-08 05:52:09,202 - lava_callback - ERROR - Error processing callback for node 69fad6f6e18d38d4eb00292f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49652 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:52:49,169 - lava_callback - INFO - Received callback for node 69fad728e18d38d4eb00293f INFO: 172.20.0.1:49658 - "POST /node/69fad728e18d38d4eb00293f HTTP/1.0" 202 Accepted 2026-05-08 05:52:49,174 - lava_callback - INFO - Starting async job submit for node 69fad728e18d38d4eb00293f 2026-05-08 05:52:49,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:52:49,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad728e18d38d4eb00293f HTTP/1.1" 200 None 2026-05-08 05:52:49,196 - lava_callback - DEBUG - Processing node 69fad728e18d38d4eb00293f: baseline-arm64-clabbe 2026-05-08 05:52:49,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad728e18d38d4eb00293f 2026-05-08 05:52:49,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:52:49,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad728e18d38d4eb00293f HTTP/1.1" 200 None 2026-05-08 05:52:49,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:52:49,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:52:49,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:52:49,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad728e18d38d4eb00293f HTTP/1.1" 200 None 2026-05-08 05:52:49,245 - lava_callback - ERROR - Error processing callback for node 69fad728e18d38d4eb00293f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40866 - "GET /node/69b27d274bce73bcf0234268%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51696 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:54:09,229 - lava_callback - INFO - Received callback for node 69fad774e18d38d4eb00295b INFO: 172.20.0.1:51712 - "POST /node/69fad774e18d38d4eb00295b HTTP/1.0" 202 Accepted 2026-05-08 05:54:09,235 - lava_callback - INFO - Starting async job submit for node 69fad774e18d38d4eb00295b 2026-05-08 05:54:09,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:54:09,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad774e18d38d4eb00295b HTTP/1.1" 200 None 2026-05-08 05:54:09,249 - lava_callback - DEBUG - Processing node 69fad774e18d38d4eb00295b: baseline-arm64-clabbe 2026-05-08 05:54:09,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad774e18d38d4eb00295b 2026-05-08 05:54:09,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:54:09,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad774e18d38d4eb00295b HTTP/1.1" 200 None 2026-05-08 05:54:09,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:54:09,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-08 05:54:09,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:54:09,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad774e18d38d4eb00295b HTTP/1.1" 200 None 2026-05-08 05:54:09,295 - lava_callback - ERROR - Error processing callback for node 69fad774e18d38d4eb00295b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34012 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:55:09,286 - lava_callback - INFO - Received callback for node 69fad7b2e18d38d4eb00297e INFO: 172.20.0.1:34026 - "POST /node/69fad7b2e18d38d4eb00297e HTTP/1.0" 202 Accepted 2026-05-08 05:55:09,294 - lava_callback - INFO - Starting async job submit for node 69fad7b2e18d38d4eb00297e 2026-05-08 05:55:09,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:55:09,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad7b2e18d38d4eb00297e HTTP/1.1" 200 None 2026-05-08 05:55:09,313 - lava_callback - DEBUG - Processing node 69fad7b2e18d38d4eb00297e: baseline-arm-clabbe 2026-05-08 05:55:09,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad7b2e18d38d4eb00297e 2026-05-08 05:55:09,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:55:09,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad7b2e18d38d4eb00297e HTTP/1.1" 200 None 2026-05-08 05:55:09,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:55:09,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:55:09,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:55:09,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad7b2e18d38d4eb00297e HTTP/1.1" 200 None 2026-05-08 05:55:09,384 - lava_callback - ERROR - Error processing callback for node 69fad7b2e18d38d4eb00297e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35308 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:55:49,157 - lava_callback - INFO - Received callback for node 69fad7d7e18d38d4eb002989 INFO: 172.20.0.1:35320 - "POST /node/69fad7d7e18d38d4eb002989 HTTP/1.0" 202 Accepted 2026-05-08 05:55:49,163 - lava_callback - INFO - Starting async job submit for node 69fad7d7e18d38d4eb002989 2026-05-08 05:55:49,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:55:49,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad7d7e18d38d4eb002989 HTTP/1.1" 200 None 2026-05-08 05:55:49,178 - lava_callback - DEBUG - Processing node 69fad7d7e18d38d4eb002989: baseline-arm-clabbe 2026-05-08 05:55:49,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad7d7e18d38d4eb002989 2026-05-08 05:55:49,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:55:49,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad7d7e18d38d4eb002989 HTTP/1.1" 200 None 2026-05-08 05:55:49,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:55:49,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:55:49,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:55:49,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad7d7e18d38d4eb002989 HTTP/1.1" 200 None 2026-05-08 05:55:49,226 - lava_callback - ERROR - Error processing callback for node 69fad7d7e18d38d4eb002989: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43080 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:56:29,306 - lava_callback - INFO - Received callback for node 69fad7fee18d38d4eb002995 INFO: 172.20.0.1:43084 - "POST /node/69fad7fee18d38d4eb002995 HTTP/1.0" 202 Accepted 2026-05-08 05:56:29,313 - lava_callback - INFO - Starting async job submit for node 69fad7fee18d38d4eb002995 2026-05-08 05:56:29,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:56:29,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad7fee18d38d4eb002995 HTTP/1.1" 200 None 2026-05-08 05:56:29,330 - lava_callback - DEBUG - Processing node 69fad7fee18d38d4eb002995: baseline-arm-clabbe 2026-05-08 05:56:29,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad7fee18d38d4eb002995 2026-05-08 05:56:29,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:56:29,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad7fee18d38d4eb002995 HTTP/1.1" 200 None 2026-05-08 05:56:29,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:56:29,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:56:29,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:56:29,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad7fee18d38d4eb002995 HTTP/1.1" 200 None 2026-05-08 05:56:29,379 - lava_callback - ERROR - Error processing callback for node 69fad7fee18d38d4eb002995: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43522 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:57:09,296 - lava_callback - INFO - Received callback for node 69fad823e18d38d4eb0029a3 INFO: 172.20.0.1:43532 - "POST /node/69fad823e18d38d4eb0029a3 HTTP/1.0" 202 Accepted 2026-05-08 05:57:09,302 - lava_callback - INFO - Starting async job submit for node 69fad823e18d38d4eb0029a3 2026-05-08 05:57:09,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:57:09,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad823e18d38d4eb0029a3 HTTP/1.1" 200 None 2026-05-08 05:57:09,321 - lava_callback - DEBUG - Processing node 69fad823e18d38d4eb0029a3: baseline-arm-clabbe 2026-05-08 05:57:09,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad823e18d38d4eb0029a3 2026-05-08 05:57:09,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:57:09,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad823e18d38d4eb0029a3 HTTP/1.1" 200 None 2026-05-08 05:57:09,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:57:09,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:57:09,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:57:09,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad823e18d38d4eb0029a3 HTTP/1.1" 200 None 2026-05-08 05:57:09,381 - lava_callback - ERROR - Error processing callback for node 69fad823e18d38d4eb0029a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51686 - "GET / HTTP/1.0" 200 OK 2026-05-08 05:57:49,278 - lava_callback - INFO - Received callback for node 69fad848e18d38d4eb0029b4 INFO: 172.20.0.1:51702 - "POST /node/69fad848e18d38d4eb0029b4 HTTP/1.0" 202 Accepted 2026-05-08 05:57:49,285 - lava_callback - INFO - Starting async job submit for node 69fad848e18d38d4eb0029b4 2026-05-08 05:57:49,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:57:49,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad848e18d38d4eb0029b4 HTTP/1.1" 200 None 2026-05-08 05:57:49,307 - lava_callback - DEBUG - Processing node 69fad848e18d38d4eb0029b4: baseline-arm-clabbe 2026-05-08 05:57:49,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fad848e18d38d4eb0029b4 2026-05-08 05:57:49,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:57:49,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fad848e18d38d4eb0029b4 HTTP/1.1" 200 None 2026-05-08 05:57:49,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:57:49,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-08 05:57:49,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 05:57:49,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fad848e18d38d4eb0029b4 HTTP/1.1" 200 None 2026-05-08 05:57:49,373 - lava_callback - ERROR - Error processing callback for node 69fad848e18d38d4eb0029b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34710 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:44:19,524 - lava_callback - INFO - Received callback for node 69fae33ee18d38d4eb002a54 INFO: 172.20.0.1:34724 - "POST /node/69fae33ee18d38d4eb002a54 HTTP/1.0" 202 Accepted 2026-05-08 06:44:19,530 - lava_callback - INFO - Starting async job submit for node 69fae33ee18d38d4eb002a54 2026-05-08 06:44:19,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:44:19,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae33ee18d38d4eb002a54 HTTP/1.1" 200 None 2026-05-08 06:44:19,545 - lava_callback - DEBUG - Processing node 69fae33ee18d38d4eb002a54: baseline-arm-baylibre 2026-05-08 06:44:19,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae33ee18d38d4eb002a54 2026-05-08 06:44:19,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:44:19,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae33ee18d38d4eb002a54 HTTP/1.1" 200 None 2026-05-08 06:44:19,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:44:19,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:44:19,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:44:19,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae33ee18d38d4eb002a54 HTTP/1.1" 200 None 2026-05-08 06:44:19,594 - lava_callback - ERROR - Error processing callback for node 69fae33ee18d38d4eb002a54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39186 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:44:59,370 - lava_callback - INFO - Received callback for node 69fae363e18d38d4eb002a63 INFO: 172.20.0.1:39194 - "POST /node/69fae363e18d38d4eb002a63 HTTP/1.0" 202 Accepted 2026-05-08 06:44:59,377 - lava_callback - INFO - Starting async job submit for node 69fae363e18d38d4eb002a63 2026-05-08 06:44:59,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:44:59,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae363e18d38d4eb002a63 HTTP/1.1" 200 None 2026-05-08 06:44:59,391 - lava_callback - DEBUG - Processing node 69fae363e18d38d4eb002a63: baseline-arm-baylibre 2026-05-08 06:44:59,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae363e18d38d4eb002a63 2026-05-08 06:44:59,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:44:59,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae363e18d38d4eb002a63 HTTP/1.1" 200 None 2026-05-08 06:44:59,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:44:59,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:44:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:44:59,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae363e18d38d4eb002a63 HTTP/1.1" 200 None 2026-05-08 06:44:59,435 - lava_callback - ERROR - Error processing callback for node 69fae363e18d38d4eb002a63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37858 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:45:39,471 - lava_callback - INFO - Received callback for node 69fae387e18d38d4eb002a75 INFO: 172.20.0.1:37874 - "POST /node/69fae387e18d38d4eb002a75 HTTP/1.0" 202 Accepted 2026-05-08 06:45:39,477 - lava_callback - INFO - Starting async job submit for node 69fae387e18d38d4eb002a75 2026-05-08 06:45:39,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:45:39,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae387e18d38d4eb002a75 HTTP/1.1" 200 None 2026-05-08 06:45:39,492 - lava_callback - DEBUG - Processing node 69fae387e18d38d4eb002a75: baseline-arm-baylibre 2026-05-08 06:45:39,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae387e18d38d4eb002a75 2026-05-08 06:45:39,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:45:39,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae387e18d38d4eb002a75 HTTP/1.1" 200 None 2026-05-08 06:45:39,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:45:39,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:45:39,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:45:39,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae387e18d38d4eb002a75 HTTP/1.1" 200 None 2026-05-08 06:45:39,541 - lava_callback - ERROR - Error processing callback for node 69fae387e18d38d4eb002a75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44730 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:46:19,429 - lava_callback - INFO - Received callback for node 69fae3ace18d38d4eb002a80 INFO: 172.20.0.1:44734 - "POST /node/69fae3ace18d38d4eb002a80 HTTP/1.0" 202 Accepted 2026-05-08 06:46:19,434 - lava_callback - INFO - Starting async job submit for node 69fae3ace18d38d4eb002a80 2026-05-08 06:46:19,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:46:19,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae3ace18d38d4eb002a80 HTTP/1.1" 200 None 2026-05-08 06:46:19,450 - lava_callback - DEBUG - Processing node 69fae3ace18d38d4eb002a80: baseline-arm-baylibre 2026-05-08 06:46:19,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae3ace18d38d4eb002a80 2026-05-08 06:46:19,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:46:19,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae3ace18d38d4eb002a80 HTTP/1.1" 200 None 2026-05-08 06:46:19,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:46:19,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:46:19,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:46:19,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae3ace18d38d4eb002a80 HTTP/1.1" 200 None 2026-05-08 06:46:19,499 - lava_callback - ERROR - Error processing callback for node 69fae3ace18d38d4eb002a80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46110 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:46:59,519 - lava_callback - INFO - Received callback for node 69fae3d1e18d38d4eb002a8e INFO: 172.20.0.1:46120 - "POST /node/69fae3d1e18d38d4eb002a8e HTTP/1.0" 202 Accepted 2026-05-08 06:46:59,525 - lava_callback - INFO - Starting async job submit for node 69fae3d1e18d38d4eb002a8e 2026-05-08 06:46:59,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:46:59,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae3d1e18d38d4eb002a8e HTTP/1.1" 200 None 2026-05-08 06:46:59,540 - lava_callback - DEBUG - Processing node 69fae3d1e18d38d4eb002a8e: baseline-arm-baylibre 2026-05-08 06:46:59,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae3d1e18d38d4eb002a8e 2026-05-08 06:46:59,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:46:59,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae3d1e18d38d4eb002a8e HTTP/1.1" 200 None 2026-05-08 06:46:59,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:46:59,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:46:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:46:59,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae3d1e18d38d4eb002a8e HTTP/1.1" 200 None 2026-05-08 06:46:59,584 - lava_callback - ERROR - Error processing callback for node 69fae3d1e18d38d4eb002a8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57114 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:47:31,478 - lava_callback - INFO - Received callback for node 69fae3f8e18d38d4eb002a9c INFO: 172.20.0.1:55428 - "POST /node/69fae3f8e18d38d4eb002a9c HTTP/1.0" 202 Accepted 2026-05-08 06:47:31,488 - lava_callback - INFO - Starting async job submit for node 69fae3f8e18d38d4eb002a9c 2026-05-08 06:47:31,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:47:31,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae3f8e18d38d4eb002a9c HTTP/1.1" 200 None 2026-05-08 06:47:31,505 - lava_callback - DEBUG - Processing node 69fae3f8e18d38d4eb002a9c: baseline-arm-clabbe 2026-05-08 06:47:31,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae3f8e18d38d4eb002a9c 2026-05-08 06:47:31,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:47:31,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae3f8e18d38d4eb002a9c HTTP/1.1" 200 None 2026-05-08 06:47:31,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:47:31,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:47:31,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:47:31,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae3f8e18d38d4eb002a9c HTTP/1.1" 200 None 2026-05-08 06:47:31,555 - lava_callback - ERROR - Error processing callback for node 69fae3f8e18d38d4eb002a9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60266 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-05-08 06:49:11,287 - lava_callback - INFO - Received callback for node 69fae463e18d38d4eb002abf INFO: 172.20.0.1:39296 - "POST /node/69fae463e18d38d4eb002abf HTTP/1.0" 202 Accepted 2026-05-08 06:49:11,292 - lava_callback - INFO - Starting async job submit for node 69fae463e18d38d4eb002abf 2026-05-08 06:49:11,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:49:11,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae463e18d38d4eb002abf HTTP/1.1" 200 None 2026-05-08 06:49:11,308 - lava_callback - DEBUG - Processing node 69fae463e18d38d4eb002abf: baseline-arm-clabbe 2026-05-08 06:49:11,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae463e18d38d4eb002abf 2026-05-08 06:49:11,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:49:11,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae463e18d38d4eb002abf HTTP/1.1" 200 None 2026-05-08 06:49:11,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:49:11,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:49:11,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:49:11,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae463e18d38d4eb002abf HTTP/1.1" 200 None 2026-05-08 06:49:11,369 - lava_callback - ERROR - Error processing callback for node 69fae463e18d38d4eb002abf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36018 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:49:51,368 - lava_callback - INFO - Received callback for node 69fae488e18d38d4eb002acd INFO: 172.20.0.1:48584 - "POST /node/69fae488e18d38d4eb002acd HTTP/1.0" 202 Accepted 2026-05-08 06:49:51,374 - lava_callback - INFO - Starting async job submit for node 69fae488e18d38d4eb002acd 2026-05-08 06:49:51,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:49:51,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae488e18d38d4eb002acd HTTP/1.1" 200 None 2026-05-08 06:49:51,391 - lava_callback - DEBUG - Processing node 69fae488e18d38d4eb002acd: baseline-arm-clabbe 2026-05-08 06:49:51,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae488e18d38d4eb002acd 2026-05-08 06:49:51,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:49:51,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae488e18d38d4eb002acd HTTP/1.1" 200 None 2026-05-08 06:49:51,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:49:51,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:49:51,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:49:51,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae488e18d38d4eb002acd HTTP/1.1" 200 None 2026-05-08 06:49:51,442 - lava_callback - ERROR - Error processing callback for node 69fae488e18d38d4eb002acd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53018 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:50:31,355 - lava_callback - INFO - Received callback for node 69fae4ade18d38d4eb002ada INFO: 172.20.0.1:48474 - "POST /node/69fae4ade18d38d4eb002ada HTTP/1.0" 202 Accepted 2026-05-08 06:50:31,364 - lava_callback - INFO - Starting async job submit for node 69fae4ade18d38d4eb002ada 2026-05-08 06:50:31,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:50:31,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae4ade18d38d4eb002ada HTTP/1.1" 200 None 2026-05-08 06:50:31,421 - lava_callback - DEBUG - Processing node 69fae4ade18d38d4eb002ada: baseline-arm-clabbe 2026-05-08 06:50:31,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae4ade18d38d4eb002ada 2026-05-08 06:50:31,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:50:31,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae4ade18d38d4eb002ada HTTP/1.1" 200 None 2026-05-08 06:50:31,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:50:31,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:50:31,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:50:31,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae4ade18d38d4eb002ada HTTP/1.1" 200 None 2026-05-08 06:50:31,488 - lava_callback - ERROR - Error processing callback for node 69fae4ade18d38d4eb002ada: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44808 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:51:11,343 - lava_callback - INFO - Received callback for node 69fae4d2e18d38d4eb002aee INFO: 172.20.0.1:53080 - "POST /node/69fae4d2e18d38d4eb002aee HTTP/1.0" 202 Accepted 2026-05-08 06:51:11,349 - lava_callback - INFO - Starting async job submit for node 69fae4d2e18d38d4eb002aee 2026-05-08 06:51:11,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:51:11,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae4d2e18d38d4eb002aee HTTP/1.1" 200 None 2026-05-08 06:51:11,371 - lava_callback - DEBUG - Processing node 69fae4d2e18d38d4eb002aee: baseline-arm-clabbe 2026-05-08 06:51:11,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae4d2e18d38d4eb002aee 2026-05-08 06:51:11,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:51:11,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae4d2e18d38d4eb002aee HTTP/1.1" 200 None 2026-05-08 06:51:11,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:51:11,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:51:11,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:51:11,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae4d2e18d38d4eb002aee HTTP/1.1" 200 None 2026-05-08 06:51:11,429 - lava_callback - ERROR - Error processing callback for node 69fae4d2e18d38d4eb002aee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57870 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:51:51,424 - lava_callback - INFO - Received callback for node 69fae4f7e18d38d4eb002afa INFO: 172.20.0.1:51956 - "POST /node/69fae4f7e18d38d4eb002afa HTTP/1.0" 202 Accepted 2026-05-08 06:51:51,430 - lava_callback - INFO - Starting async job submit for node 69fae4f7e18d38d4eb002afa 2026-05-08 06:51:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:51:51,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae4f7e18d38d4eb002afa HTTP/1.1" 200 None 2026-05-08 06:51:51,449 - lava_callback - DEBUG - Processing node 69fae4f7e18d38d4eb002afa: baseline-arm-clabbe 2026-05-08 06:51:51,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae4f7e18d38d4eb002afa 2026-05-08 06:51:51,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:51:51,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae4f7e18d38d4eb002afa HTTP/1.1" 200 None 2026-05-08 06:51:51,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:51:51,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:51:51,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:51:51,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae4f7e18d38d4eb002afa HTTP/1.1" 200 None 2026-05-08 06:51:51,509 - lava_callback - ERROR - Error processing callback for node 69fae4f7e18d38d4eb002afa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36286 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:52:31,456 - lava_callback - INFO - Received callback for node 69fae51de18d38d4eb002b05 INFO: 172.20.0.1:39308 - "POST /node/69fae51de18d38d4eb002b05 HTTP/1.0" 202 Accepted 2026-05-08 06:52:31,461 - lava_callback - INFO - Starting async job submit for node 69fae51de18d38d4eb002b05 2026-05-08 06:52:31,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:52:31,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae51de18d38d4eb002b05 HTTP/1.1" 200 None 2026-05-08 06:52:31,477 - lava_callback - DEBUG - Processing node 69fae51de18d38d4eb002b05: baseline-arm-clabbe 2026-05-08 06:52:31,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae51de18d38d4eb002b05 2026-05-08 06:52:31,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:52:31,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae51de18d38d4eb002b05 HTTP/1.1" 200 None 2026-05-08 06:52:31,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:52:31,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 06:52:31,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:52:31,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae51de18d38d4eb002b05 HTTP/1.1" 200 None 2026-05-08 06:52:31,529 - lava_callback - ERROR - Error processing callback for node 69fae51de18d38d4eb002b05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35500 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:52:59,845 - lava_callback - INFO - Received callback for node 69fae53ce18d38d4eb002b0f INFO: 172.20.0.1:47936 - "POST /node/69fae53ce18d38d4eb002b0f HTTP/1.0" 202 Accepted 2026-05-08 06:52:59,850 - lava_callback - INFO - Starting async job submit for node 69fae53ce18d38d4eb002b0f 2026-05-08 06:52:59,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:52:59,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae53ce18d38d4eb002b0f HTTP/1.1" 200 None 2026-05-08 06:52:59,869 - lava_callback - DEBUG - Processing node 69fae53ce18d38d4eb002b0f: baseline-arm-baylibre 2026-05-08 06:52:59,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae53ce18d38d4eb002b0f 2026-05-08 06:52:59,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:52:59,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae53ce18d38d4eb002b0f HTTP/1.1" 200 None 2026-05-08 06:52:59,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:52:59,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:52:59,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:52:59,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae53ce18d38d4eb002b0f HTTP/1.1" 200 None 2026-05-08 06:52:59,915 - lava_callback - ERROR - Error processing callback for node 69fae53ce18d38d4eb002b0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46170 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:53:59,833 - lava_callback - INFO - Received callback for node 69fae583e18d38d4eb002b22 INFO: 172.20.0.1:45688 - "POST /node/69fae583e18d38d4eb002b22 HTTP/1.0" 202 Accepted 2026-05-08 06:53:59,838 - lava_callback - INFO - Starting async job submit for node 69fae583e18d38d4eb002b22 2026-05-08 06:53:59,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:53:59,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae583e18d38d4eb002b22 HTTP/1.1" 200 None 2026-05-08 06:53:59,853 - lava_callback - DEBUG - Processing node 69fae583e18d38d4eb002b22: baseline-arm-baylibre 2026-05-08 06:53:59,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae583e18d38d4eb002b22 2026-05-08 06:53:59,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:53:59,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae583e18d38d4eb002b22 HTTP/1.1" 200 None 2026-05-08 06:53:59,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:53:59,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:53:59,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:53:59,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae583e18d38d4eb002b22 HTTP/1.1" 200 None 2026-05-08 06:53:59,908 - lava_callback - ERROR - Error processing callback for node 69fae583e18d38d4eb002b22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49146 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:54:39,886 - lava_callback - INFO - Received callback for node 69fae5a7e18d38d4eb002b31 INFO: 172.20.0.1:46560 - "POST /node/69fae5a7e18d38d4eb002b31 HTTP/1.0" 202 Accepted 2026-05-08 06:54:39,891 - lava_callback - INFO - Starting async job submit for node 69fae5a7e18d38d4eb002b31 2026-05-08 06:54:39,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:54:39,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae5a7e18d38d4eb002b31 HTTP/1.1" 200 None 2026-05-08 06:54:39,907 - lava_callback - DEBUG - Processing node 69fae5a7e18d38d4eb002b31: baseline-arm-baylibre 2026-05-08 06:54:39,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae5a7e18d38d4eb002b31 2026-05-08 06:54:39,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:54:39,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae5a7e18d38d4eb002b31 HTTP/1.1" 200 None 2026-05-08 06:54:39,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:54:39,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:54:39,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:54:39,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae5a7e18d38d4eb002b31 HTTP/1.1" 200 None 2026-05-08 06:54:39,956 - lava_callback - ERROR - Error processing callback for node 69fae5a7e18d38d4eb002b31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36756 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:55:19,918 - lava_callback - INFO - Received callback for node 69fae5cbe18d38d4eb002b3e INFO: 172.20.0.1:58376 - "POST /node/69fae5cbe18d38d4eb002b3e HTTP/1.0" 202 Accepted 2026-05-08 06:55:19,924 - lava_callback - INFO - Starting async job submit for node 69fae5cbe18d38d4eb002b3e 2026-05-08 06:55:19,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:55:19,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae5cbe18d38d4eb002b3e HTTP/1.1" 200 None 2026-05-08 06:55:19,938 - lava_callback - DEBUG - Processing node 69fae5cbe18d38d4eb002b3e: baseline-arm-baylibre 2026-05-08 06:55:19,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae5cbe18d38d4eb002b3e 2026-05-08 06:55:19,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:55:19,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae5cbe18d38d4eb002b3e HTTP/1.1" 200 None 2026-05-08 06:55:19,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:55:19,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:55:19,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:55:19,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae5cbe18d38d4eb002b3e HTTP/1.1" 200 None 2026-05-08 06:55:19,990 - lava_callback - ERROR - Error processing callback for node 69fae5cbe18d38d4eb002b3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36124 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:56:00,031 - lava_callback - INFO - Received callback for node 69fae5efe18d38d4eb002b4a INFO: 172.20.0.1:56822 - "POST /node/69fae5efe18d38d4eb002b4a HTTP/1.0" 202 Accepted 2026-05-08 06:56:00,037 - lava_callback - INFO - Starting async job submit for node 69fae5efe18d38d4eb002b4a 2026-05-08 06:56:00,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:56:00,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae5efe18d38d4eb002b4a HTTP/1.1" 200 None 2026-05-08 06:56:00,061 - lava_callback - DEBUG - Processing node 69fae5efe18d38d4eb002b4a: baseline-arm-baylibre 2026-05-08 06:56:00,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae5efe18d38d4eb002b4a 2026-05-08 06:56:00,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:56:00,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae5efe18d38d4eb002b4a HTTP/1.1" 200 None 2026-05-08 06:56:00,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:56:00,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:56:00,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:56:00,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae5efe18d38d4eb002b4a HTTP/1.1" 200 None 2026-05-08 06:56:00,109 - lava_callback - ERROR - Error processing callback for node 69fae5efe18d38d4eb002b4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35428 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:56:40,012 - lava_callback - INFO - Received callback for node 69fae613e18d38d4eb002b5a INFO: 172.20.0.1:56942 - "POST /node/69fae613e18d38d4eb002b5a HTTP/1.0" 202 Accepted 2026-05-08 06:56:40,021 - lava_callback - INFO - Starting async job submit for node 69fae613e18d38d4eb002b5a 2026-05-08 06:56:40,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:56:40,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae613e18d38d4eb002b5a HTTP/1.1" 200 None 2026-05-08 06:56:40,041 - lava_callback - DEBUG - Processing node 69fae613e18d38d4eb002b5a: baseline-arm-baylibre 2026-05-08 06:56:40,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae613e18d38d4eb002b5a 2026-05-08 06:56:40,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:56:40,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae613e18d38d4eb002b5a HTTP/1.1" 200 None 2026-05-08 06:56:40,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:56:40,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:56:40,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:56:40,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae613e18d38d4eb002b5a HTTP/1.1" 200 None 2026-05-08 06:56:40,094 - lava_callback - ERROR - Error processing callback for node 69fae613e18d38d4eb002b5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45036 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:57:00,009 - lava_callback - INFO - Received callback for node 69fae639e18d38d4eb002b6d INFO: 172.20.0.1:48114 - "POST /node/69fae639e18d38d4eb002b6d HTTP/1.0" 202 Accepted 2026-05-08 06:57:00,014 - lava_callback - INFO - Starting async job submit for node 69fae639e18d38d4eb002b6d 2026-05-08 06:57:00,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:57:00,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae639e18d38d4eb002b6d HTTP/1.1" 200 None 2026-05-08 06:57:00,030 - lava_callback - DEBUG - Processing node 69fae639e18d38d4eb002b6d: baseline-arm-baylibre 2026-05-08 06:57:00,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae639e18d38d4eb002b6d 2026-05-08 06:57:00,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:57:00,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae639e18d38d4eb002b6d HTTP/1.1" 200 None 2026-05-08 06:57:00,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:57:00,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:57:00,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:57:00,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae639e18d38d4eb002b6d HTTP/1.1" 200 None 2026-05-08 06:57:00,081 - lava_callback - ERROR - Error processing callback for node 69fae639e18d38d4eb002b6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37572 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:57:40,231 - lava_callback - INFO - Received callback for node 69fae65ce18d38d4eb002b79 INFO: 172.20.0.1:34836 - "POST /node/69fae65ce18d38d4eb002b79 HTTP/1.0" 202 Accepted 2026-05-08 06:57:40,236 - lava_callback - INFO - Starting async job submit for node 69fae65ce18d38d4eb002b79 2026-05-08 06:57:40,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:57:40,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae65ce18d38d4eb002b79 HTTP/1.1" 200 None 2026-05-08 06:57:40,252 - lava_callback - DEBUG - Processing node 69fae65ce18d38d4eb002b79: baseline-arm-baylibre 2026-05-08 06:57:40,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae65ce18d38d4eb002b79 2026-05-08 06:57:40,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:57:40,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae65ce18d38d4eb002b79 HTTP/1.1" 200 None 2026-05-08 06:57:40,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:57:40,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:57:40,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:57:40,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae65ce18d38d4eb002b79 HTTP/1.1" 200 None 2026-05-08 06:57:40,304 - lava_callback - ERROR - Error processing callback for node 69fae65ce18d38d4eb002b79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50276 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:58:20,149 - lava_callback - INFO - Received callback for node 69fae681e18d38d4eb002b85 INFO: 172.20.0.1:57654 - "POST /node/69fae681e18d38d4eb002b85 HTTP/1.0" 202 Accepted 2026-05-08 06:58:20,154 - lava_callback - INFO - Starting async job submit for node 69fae681e18d38d4eb002b85 2026-05-08 06:58:20,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:58:20,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae681e18d38d4eb002b85 HTTP/1.1" 200 None 2026-05-08 06:58:20,169 - lava_callback - DEBUG - Processing node 69fae681e18d38d4eb002b85: baseline-arm-baylibre 2026-05-08 06:58:20,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae681e18d38d4eb002b85 2026-05-08 06:58:20,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:58:20,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae681e18d38d4eb002b85 HTTP/1.1" 200 None 2026-05-08 06:58:20,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:58:20,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:58:20,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:58:20,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae681e18d38d4eb002b85 HTTP/1.1" 200 None 2026-05-08 06:58:20,218 - lava_callback - ERROR - Error processing callback for node 69fae681e18d38d4eb002b85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:59:00,152 - lava_callback - INFO - Received callback for node 69fae6a6e18d38d4eb002b97 INFO: 172.20.0.1:52018 - "POST /node/69fae6a6e18d38d4eb002b97 HTTP/1.0" 202 Accepted 2026-05-08 06:59:00,158 - lava_callback - INFO - Starting async job submit for node 69fae6a6e18d38d4eb002b97 2026-05-08 06:59:00,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:59:00,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae6a6e18d38d4eb002b97 HTTP/1.1" 200 None 2026-05-08 06:59:00,173 - lava_callback - DEBUG - Processing node 69fae6a6e18d38d4eb002b97: baseline-arm-baylibre 2026-05-08 06:59:00,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae6a6e18d38d4eb002b97 2026-05-08 06:59:00,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:59:00,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae6a6e18d38d4eb002b97 HTTP/1.1" 200 None 2026-05-08 06:59:00,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:59:00,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:59:00,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:59:00,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae6a6e18d38d4eb002b97 HTTP/1.1" 200 None 2026-05-08 06:59:00,221 - lava_callback - ERROR - Error processing callback for node 69fae6a6e18d38d4eb002b97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34160 - "GET / HTTP/1.0" 200 OK 2026-05-08 06:59:40,158 - lava_callback - INFO - Received callback for node 69fae6cae18d38d4eb002ba6 INFO: 172.20.0.1:52538 - "POST /node/69fae6cae18d38d4eb002ba6 HTTP/1.0" 202 Accepted 2026-05-08 06:59:40,163 - lava_callback - INFO - Starting async job submit for node 69fae6cae18d38d4eb002ba6 2026-05-08 06:59:40,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:59:40,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae6cae18d38d4eb002ba6 HTTP/1.1" 200 None 2026-05-08 06:59:40,186 - lava_callback - DEBUG - Processing node 69fae6cae18d38d4eb002ba6: baseline-arm-baylibre 2026-05-08 06:59:40,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae6cae18d38d4eb002ba6 2026-05-08 06:59:40,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:59:40,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae6cae18d38d4eb002ba6 HTTP/1.1" 200 None 2026-05-08 06:59:40,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:59:40,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 06:59:40,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 06:59:40,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae6cae18d38d4eb002ba6 HTTP/1.1" 200 None 2026-05-08 06:59:40,232 - lava_callback - ERROR - Error processing callback for node 69fae6cae18d38d4eb002ba6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44464 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:00:12,189 - lava_callback - INFO - Received callback for node 69fae6f0e18d38d4eb002bb8 INFO: 172.20.0.1:48594 - "POST /node/69fae6f0e18d38d4eb002bb8 HTTP/1.0" 202 Accepted 2026-05-08 07:00:12,195 - lava_callback - INFO - Starting async job submit for node 69fae6f0e18d38d4eb002bb8 2026-05-08 07:00:12,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:00:12,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae6f0e18d38d4eb002bb8 HTTP/1.1" 200 None 2026-05-08 07:00:12,213 - lava_callback - DEBUG - Processing node 69fae6f0e18d38d4eb002bb8: baseline-arm-clabbe 2026-05-08 07:00:12,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae6f0e18d38d4eb002bb8 2026-05-08 07:00:12,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:00:12,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae6f0e18d38d4eb002bb8 HTTP/1.1" 200 None 2026-05-08 07:00:12,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:00:12,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:00:12,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:00:12,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae6f0e18d38d4eb002bb8 HTTP/1.1" 200 None 2026-05-08 07:00:12,277 - lava_callback - ERROR - Error processing callback for node 69fae6f0e18d38d4eb002bb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50680 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:00:51,828 - lava_callback - INFO - Received callback for node 69fae716e18d38d4eb002bc4 INFO: 172.20.0.1:57286 - "POST /node/69fae716e18d38d4eb002bc4 HTTP/1.0" 202 Accepted 2026-05-08 07:00:51,833 - lava_callback - INFO - Starting async job submit for node 69fae716e18d38d4eb002bc4 2026-05-08 07:00:51,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:00:51,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae716e18d38d4eb002bc4 HTTP/1.1" 200 None 2026-05-08 07:00:51,859 - lava_callback - DEBUG - Processing node 69fae716e18d38d4eb002bc4: baseline-arm-clabbe 2026-05-08 07:00:51,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae716e18d38d4eb002bc4 2026-05-08 07:00:51,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:00:51,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae716e18d38d4eb002bc4 HTTP/1.1" 200 None 2026-05-08 07:00:51,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:00:51,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:00:51,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:00:51,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae716e18d38d4eb002bc4 HTTP/1.1" 200 None 2026-05-08 07:00:51,909 - lava_callback - ERROR - Error processing callback for node 69fae716e18d38d4eb002bc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59716 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:01:31,921 - lava_callback - INFO - Received callback for node 69fae73ce18d38d4eb002bd3 INFO: 172.20.0.1:52340 - "POST /node/69fae73ce18d38d4eb002bd3 HTTP/1.0" 202 Accepted 2026-05-08 07:01:31,927 - lava_callback - INFO - Starting async job submit for node 69fae73ce18d38d4eb002bd3 2026-05-08 07:01:31,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:01:31,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae73ce18d38d4eb002bd3 HTTP/1.1" 200 None 2026-05-08 07:01:31,941 - lava_callback - DEBUG - Processing node 69fae73ce18d38d4eb002bd3: baseline-arm-clabbe 2026-05-08 07:01:31,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae73ce18d38d4eb002bd3 2026-05-08 07:01:31,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:01:31,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae73ce18d38d4eb002bd3 HTTP/1.1" 200 None 2026-05-08 07:01:31,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:01:31,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:01:31,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:01:31,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae73ce18d38d4eb002bd3 HTTP/1.1" 200 None 2026-05-08 07:01:31,998 - lava_callback - ERROR - Error processing callback for node 69fae73ce18d38d4eb002bd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48514 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:02:11,901 - lava_callback - INFO - Received callback for node 69fae761e18d38d4eb002be2 INFO: 172.20.0.1:39458 - "POST /node/69fae761e18d38d4eb002be2 HTTP/1.0" 202 Accepted 2026-05-08 07:02:11,906 - lava_callback - INFO - Starting async job submit for node 69fae761e18d38d4eb002be2 2026-05-08 07:02:11,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:02:11,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae761e18d38d4eb002be2 HTTP/1.1" 200 None 2026-05-08 07:02:11,924 - lava_callback - DEBUG - Processing node 69fae761e18d38d4eb002be2: baseline-arm-clabbe 2026-05-08 07:02:11,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae761e18d38d4eb002be2 2026-05-08 07:02:11,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:02:11,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae761e18d38d4eb002be2 HTTP/1.1" 200 None 2026-05-08 07:02:11,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:02:11,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:02:11,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:02:11,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae761e18d38d4eb002be2 HTTP/1.1" 200 None 2026-05-08 07:02:11,970 - lava_callback - ERROR - Error processing callback for node 69fae761e18d38d4eb002be2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52304 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:02:51,916 - lava_callback - INFO - Received callback for node 69fae787e18d38d4eb002bf4 INFO: 172.20.0.1:52628 - "POST /node/69fae787e18d38d4eb002bf4 HTTP/1.0" 202 Accepted 2026-05-08 07:02:51,921 - lava_callback - INFO - Starting async job submit for node 69fae787e18d38d4eb002bf4 2026-05-08 07:02:51,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:02:51,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae787e18d38d4eb002bf4 HTTP/1.1" 200 None 2026-05-08 07:02:51,944 - lava_callback - DEBUG - Processing node 69fae787e18d38d4eb002bf4: baseline-arm-clabbe 2026-05-08 07:02:51,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae787e18d38d4eb002bf4 2026-05-08 07:02:51,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:02:51,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae787e18d38d4eb002bf4 HTTP/1.1" 200 None 2026-05-08 07:02:51,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:02:51,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:02:51,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:02:52,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae787e18d38d4eb002bf4 HTTP/1.1" 200 None 2026-05-08 07:02:52,004 - lava_callback - ERROR - Error processing callback for node 69fae787e18d38d4eb002bf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44490 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:03:11,899 - lava_callback - INFO - Received callback for node 69fae7ace18d38d4eb002c01 INFO: 172.20.0.1:50760 - "POST /node/69fae7ace18d38d4eb002c01 HTTP/1.0" 202 Accepted 2026-05-08 07:03:11,905 - lava_callback - INFO - Starting async job submit for node 69fae7ace18d38d4eb002c01 2026-05-08 07:03:11,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:03:11,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae7ace18d38d4eb002c01 HTTP/1.1" 200 None 2026-05-08 07:03:11,927 - lava_callback - DEBUG - Processing node 69fae7ace18d38d4eb002c01: baseline-arm-clabbe 2026-05-08 07:03:11,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae7ace18d38d4eb002c01 2026-05-08 07:03:11,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:03:11,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae7ace18d38d4eb002c01 HTTP/1.1" 200 None 2026-05-08 07:03:11,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:03:11,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:03:11,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:03:11,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae7ace18d38d4eb002c01 HTTP/1.1" 200 None 2026-05-08 07:03:11,986 - lava_callback - ERROR - Error processing callback for node 69fae7ace18d38d4eb002c01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59512 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:03:52,007 - lava_callback - INFO - Received callback for node 69fae7d2e18d38d4eb002c11 INFO: 172.20.0.1:42140 - "POST /node/69fae7d2e18d38d4eb002c11 HTTP/1.0" 202 Accepted 2026-05-08 07:03:52,013 - lava_callback - INFO - Starting async job submit for node 69fae7d2e18d38d4eb002c11 2026-05-08 07:03:52,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:03:52,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae7d2e18d38d4eb002c11 HTTP/1.1" 200 None 2026-05-08 07:03:52,029 - lava_callback - DEBUG - Processing node 69fae7d2e18d38d4eb002c11: baseline-arm-clabbe 2026-05-08 07:03:52,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae7d2e18d38d4eb002c11 2026-05-08 07:03:52,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:03:52,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae7d2e18d38d4eb002c11 HTTP/1.1" 200 None 2026-05-08 07:03:52,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:03:52,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:03:52,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:03:52,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae7d2e18d38d4eb002c11 HTTP/1.1" 200 None 2026-05-08 07:03:52,083 - lava_callback - ERROR - Error processing callback for node 69fae7d2e18d38d4eb002c11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52836 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:04:31,946 - lava_callback - INFO - Received callback for node 69fae7f6e18d38d4eb002c20 INFO: 172.20.0.1:50366 - "POST /node/69fae7f6e18d38d4eb002c20 HTTP/1.0" 202 Accepted 2026-05-08 07:04:31,951 - lava_callback - INFO - Starting async job submit for node 69fae7f6e18d38d4eb002c20 2026-05-08 07:04:31,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:04:31,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae7f6e18d38d4eb002c20 HTTP/1.1" 200 None 2026-05-08 07:04:31,968 - lava_callback - DEBUG - Processing node 69fae7f6e18d38d4eb002c20: baseline-arm-clabbe 2026-05-08 07:04:31,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae7f6e18d38d4eb002c20 2026-05-08 07:04:31,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:04:31,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae7f6e18d38d4eb002c20 HTTP/1.1" 200 None 2026-05-08 07:04:31,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:04:31,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:04:31,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:04:32,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae7f6e18d38d4eb002c20 HTTP/1.1" 200 None 2026-05-08 07:04:32,029 - lava_callback - ERROR - Error processing callback for node 69fae7f6e18d38d4eb002c20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35666 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:05:11,995 - lava_callback - INFO - Received callback for node 69fae81be18d38d4eb002c33 INFO: 172.20.0.1:40370 - "POST /node/69fae81be18d38d4eb002c33 HTTP/1.0" 202 Accepted 2026-05-08 07:05:12,001 - lava_callback - INFO - Starting async job submit for node 69fae81be18d38d4eb002c33 2026-05-08 07:05:12,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:05:12,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae81be18d38d4eb002c33 HTTP/1.1" 200 None 2026-05-08 07:05:12,021 - lava_callback - DEBUG - Processing node 69fae81be18d38d4eb002c33: baseline-arm-clabbe 2026-05-08 07:05:12,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae81be18d38d4eb002c33 2026-05-08 07:05:12,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:05:12,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae81be18d38d4eb002c33 HTTP/1.1" 200 None 2026-05-08 07:05:12,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:05:12,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:05:12,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:05:12,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae81be18d38d4eb002c33 HTTP/1.1" 200 None 2026-05-08 07:05:12,075 - lava_callback - ERROR - Error processing callback for node 69fae81be18d38d4eb002c33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60214 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:05:40,613 - lava_callback - INFO - Received callback for node 69fae83ce18d38d4eb002c3f INFO: 172.20.0.1:60200 - "POST /node/69fae83ce18d38d4eb002c3f HTTP/1.0" 202 Accepted 2026-05-08 07:05:40,619 - lava_callback - INFO - Starting async job submit for node 69fae83ce18d38d4eb002c3f 2026-05-08 07:05:40,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:05:40,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae83ce18d38d4eb002c3f HTTP/1.1" 200 None 2026-05-08 07:05:40,635 - lava_callback - DEBUG - Processing node 69fae83ce18d38d4eb002c3f: baseline-arm-baylibre 2026-05-08 07:05:40,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae83ce18d38d4eb002c3f 2026-05-08 07:05:40,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:05:40,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae83ce18d38d4eb002c3f HTTP/1.1" 200 None 2026-05-08 07:05:40,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:05:40,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:05:40,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:05:40,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae83ce18d38d4eb002c3f HTTP/1.1" 200 None 2026-05-08 07:05:40,683 - lava_callback - ERROR - Error processing callback for node 69fae83ce18d38d4eb002c3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55572 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:06:20,541 - lava_callback - INFO - Received callback for node 69fae861e18d38d4eb002c4c INFO: 172.20.0.1:49240 - "POST /node/69fae861e18d38d4eb002c4c HTTP/1.0" 202 Accepted 2026-05-08 07:06:20,547 - lava_callback - INFO - Starting async job submit for node 69fae861e18d38d4eb002c4c 2026-05-08 07:06:20,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:06:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae861e18d38d4eb002c4c HTTP/1.1" 200 None 2026-05-08 07:06:20,562 - lava_callback - DEBUG - Processing node 69fae861e18d38d4eb002c4c: baseline-arm-baylibre 2026-05-08 07:06:20,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae861e18d38d4eb002c4c 2026-05-08 07:06:20,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:06:20,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae861e18d38d4eb002c4c HTTP/1.1" 200 None 2026-05-08 07:06:20,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:06:20,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:06:20,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:06:20,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae861e18d38d4eb002c4c HTTP/1.1" 200 None 2026-05-08 07:06:20,647 - lava_callback - ERROR - Error processing callback for node 69fae861e18d38d4eb002c4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47038 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:07:00,658 - lava_callback - INFO - Received callback for node 69fae886e18d38d4eb002c5d INFO: 172.20.0.1:60826 - "POST /node/69fae886e18d38d4eb002c5d HTTP/1.0" 202 Accepted 2026-05-08 07:07:00,664 - lava_callback - INFO - Starting async job submit for node 69fae886e18d38d4eb002c5d 2026-05-08 07:07:00,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:07:00,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae886e18d38d4eb002c5d HTTP/1.1" 200 None 2026-05-08 07:07:00,685 - lava_callback - DEBUG - Processing node 69fae886e18d38d4eb002c5d: baseline-arm-baylibre 2026-05-08 07:07:00,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae886e18d38d4eb002c5d 2026-05-08 07:07:00,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:07:00,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae886e18d38d4eb002c5d HTTP/1.1" 200 None 2026-05-08 07:07:00,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:07:00,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:07:00,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:07:00,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae886e18d38d4eb002c5d HTTP/1.1" 200 None 2026-05-08 07:07:00,738 - lava_callback - ERROR - Error processing callback for node 69fae886e18d38d4eb002c5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42642 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:07:40,617 - lava_callback - INFO - Received callback for node 69fae8abe18d38d4eb002c6e INFO: 172.20.0.1:55872 - "POST /node/69fae8abe18d38d4eb002c6e HTTP/1.0" 202 Accepted 2026-05-08 07:07:40,626 - lava_callback - INFO - Starting async job submit for node 69fae8abe18d38d4eb002c6e 2026-05-08 07:07:40,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:07:40,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae8abe18d38d4eb002c6e HTTP/1.1" 200 None 2026-05-08 07:07:40,645 - lava_callback - DEBUG - Processing node 69fae8abe18d38d4eb002c6e: baseline-arm-baylibre 2026-05-08 07:07:40,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae8abe18d38d4eb002c6e 2026-05-08 07:07:40,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:07:40,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae8abe18d38d4eb002c6e HTTP/1.1" 200 None 2026-05-08 07:07:40,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:07:40,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:07:40,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:07:40,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae8abe18d38d4eb002c6e HTTP/1.1" 200 None 2026-05-08 07:07:40,709 - lava_callback - ERROR - Error processing callback for node 69fae8abe18d38d4eb002c6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49170 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:08:52,147 - lava_callback - INFO - Received callback for node 69fae8f4e18d38d4eb002ca2 INFO: 172.20.0.1:57236 - "POST /node/69fae8f4e18d38d4eb002ca2 HTTP/1.0" 202 Accepted 2026-05-08 07:08:52,153 - lava_callback - INFO - Starting async job submit for node 69fae8f4e18d38d4eb002ca2 2026-05-08 07:08:52,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:08:52,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae8f4e18d38d4eb002ca2 HTTP/1.1" 200 None 2026-05-08 07:08:52,174 - lava_callback - DEBUG - Processing node 69fae8f4e18d38d4eb002ca2: baseline-arm-clabbe 2026-05-08 07:08:52,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae8f4e18d38d4eb002ca2 2026-05-08 07:08:52,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:08:52,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae8f4e18d38d4eb002ca2 HTTP/1.1" 200 None 2026-05-08 07:08:52,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:08:52,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:08:52,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:08:52,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae8f4e18d38d4eb002ca2 HTTP/1.1" 200 None 2026-05-08 07:08:52,228 - lava_callback - ERROR - Error processing callback for node 69fae8f4e18d38d4eb002ca2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52340 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:10:32,215 - lava_callback - INFO - Received callback for node 69fae95fe18d38d4eb002cf2 INFO: 172.20.0.1:41952 - "POST /node/69fae95fe18d38d4eb002cf2 HTTP/1.0" 202 Accepted 2026-05-08 07:10:32,221 - lava_callback - INFO - Starting async job submit for node 69fae95fe18d38d4eb002cf2 2026-05-08 07:10:32,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:10:32,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae95fe18d38d4eb002cf2 HTTP/1.1" 200 None 2026-05-08 07:10:32,239 - lava_callback - DEBUG - Processing node 69fae95fe18d38d4eb002cf2: baseline-arm-clabbe 2026-05-08 07:10:32,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae95fe18d38d4eb002cf2 2026-05-08 07:10:32,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:10:32,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae95fe18d38d4eb002cf2 HTTP/1.1" 200 None 2026-05-08 07:10:32,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:10:32,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:10:32,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:10:32,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae95fe18d38d4eb002cf2 HTTP/1.1" 200 None 2026-05-08 07:10:32,297 - lava_callback - ERROR - Error processing callback for node 69fae95fe18d38d4eb002cf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40800 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:12:32,348 - lava_callback - INFO - Received callback for node 69fae9cbe18d38d4eb002d25 INFO: 172.20.0.1:39832 - "POST /node/69fae9cbe18d38d4eb002d25 HTTP/1.0" 202 Accepted 2026-05-08 07:12:32,357 - lava_callback - INFO - Starting async job submit for node 69fae9cbe18d38d4eb002d25 2026-05-08 07:12:32,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:12:32,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae9cbe18d38d4eb002d25 HTTP/1.1" 200 None 2026-05-08 07:12:32,385 - lava_callback - DEBUG - Processing node 69fae9cbe18d38d4eb002d25: baseline-arm-clabbe 2026-05-08 07:12:32,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae9cbe18d38d4eb002d25 2026-05-08 07:12:32,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:12:32,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae9cbe18d38d4eb002d25 HTTP/1.1" 200 None 2026-05-08 07:12:32,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:12:32,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:12:32,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:12:32,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae9cbe18d38d4eb002d25 HTTP/1.1" 200 None 2026-05-08 07:12:32,440 - lava_callback - ERROR - Error processing callback for node 69fae9cbe18d38d4eb002d25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50638 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:12:52,240 - lava_callback - INFO - Received callback for node 69fae9f0e18d38d4eb002d39 INFO: 172.20.0.1:55334 - "POST /node/69fae9f0e18d38d4eb002d39 HTTP/1.0" 202 Accepted 2026-05-08 07:12:52,249 - lava_callback - INFO - Starting async job submit for node 69fae9f0e18d38d4eb002d39 2026-05-08 07:12:52,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:12:52,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae9f0e18d38d4eb002d39 HTTP/1.1" 200 None 2026-05-08 07:12:52,267 - lava_callback - DEBUG - Processing node 69fae9f0e18d38d4eb002d39: baseline-arm-clabbe 2026-05-08 07:12:52,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fae9f0e18d38d4eb002d39 2026-05-08 07:12:52,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:12:52,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fae9f0e18d38d4eb002d39 HTTP/1.1" 200 None 2026-05-08 07:12:52,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:12:52,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:12:52,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:12:52,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fae9f0e18d38d4eb002d39 HTTP/1.1" 200 None 2026-05-08 07:12:52,325 - lava_callback - ERROR - Error processing callback for node 69fae9f0e18d38d4eb002d39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33344 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:14:12,357 - lava_callback - INFO - Received callback for node 69faea38e18d38d4eb002d5e INFO: 172.20.0.1:44416 - "POST /node/69faea38e18d38d4eb002d5e HTTP/1.0" 202 Accepted 2026-05-08 07:14:12,365 - lava_callback - INFO - Starting async job submit for node 69faea38e18d38d4eb002d5e 2026-05-08 07:14:12,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:14:12,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faea38e18d38d4eb002d5e HTTP/1.1" 200 None 2026-05-08 07:14:12,384 - lava_callback - DEBUG - Processing node 69faea38e18d38d4eb002d5e: baseline-arm-clabbe 2026-05-08 07:14:12,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faea38e18d38d4eb002d5e 2026-05-08 07:14:12,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:14:12,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faea38e18d38d4eb002d5e HTTP/1.1" 200 None 2026-05-08 07:14:12,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:14:12,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:14:12,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:14:12,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faea38e18d38d4eb002d5e HTTP/1.1" 200 None 2026-05-08 07:14:12,446 - lava_callback - ERROR - Error processing callback for node 69faea38e18d38d4eb002d5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:14:52,279 - lava_callback - INFO - Received callback for node 69faea5de18d38d4eb002d6a INFO: 172.20.0.1:35700 - "POST /node/69faea5de18d38d4eb002d6a HTTP/1.0" 202 Accepted 2026-05-08 07:14:52,284 - lava_callback - INFO - Starting async job submit for node 69faea5de18d38d4eb002d6a 2026-05-08 07:14:52,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:14:52,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faea5de18d38d4eb002d6a HTTP/1.1" 200 None 2026-05-08 07:14:52,300 - lava_callback - DEBUG - Processing node 69faea5de18d38d4eb002d6a: baseline-arm-clabbe 2026-05-08 07:14:52,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faea5de18d38d4eb002d6a 2026-05-08 07:14:52,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:14:52,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faea5de18d38d4eb002d6a HTTP/1.1" 200 None 2026-05-08 07:14:52,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:14:52,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:14:52,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:14:52,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faea5de18d38d4eb002d6a HTTP/1.1" 200 None 2026-05-08 07:14:52,347 - lava_callback - ERROR - Error processing callback for node 69faea5de18d38d4eb002d6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45102 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:15:52,423 - lava_callback - INFO - Received callback for node 69faeaa4e18d38d4eb002d89 INFO: 172.20.0.1:41586 - "POST /node/69faeaa4e18d38d4eb002d89 HTTP/1.0" 202 Accepted 2026-05-08 07:15:52,428 - lava_callback - INFO - Starting async job submit for node 69faeaa4e18d38d4eb002d89 2026-05-08 07:15:52,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:15:52,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeaa4e18d38d4eb002d89 HTTP/1.1" 200 None 2026-05-08 07:15:52,443 - lava_callback - DEBUG - Processing node 69faeaa4e18d38d4eb002d89: baseline-arm-clabbe 2026-05-08 07:15:52,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faeaa4e18d38d4eb002d89 2026-05-08 07:15:52,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:15:52,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeaa4e18d38d4eb002d89 HTTP/1.1" 200 None 2026-05-08 07:15:52,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:15:52,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:15:52,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:15:52,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faeaa4e18d38d4eb002d89 HTTP/1.1" 200 None 2026-05-08 07:15:52,497 - lava_callback - ERROR - Error processing callback for node 69faeaa4e18d38d4eb002d89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51044 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:16:32,318 - lava_callback - INFO - Received callback for node 69faeacae18d38d4eb002d9b INFO: 172.20.0.1:48562 - "POST /node/69faeacae18d38d4eb002d9b HTTP/1.0" 202 Accepted 2026-05-08 07:16:32,323 - lava_callback - INFO - Starting async job submit for node 69faeacae18d38d4eb002d9b 2026-05-08 07:16:32,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:16:32,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeacae18d38d4eb002d9b HTTP/1.1" 200 None 2026-05-08 07:16:32,339 - lava_callback - DEBUG - Processing node 69faeacae18d38d4eb002d9b: baseline-arm-clabbe 2026-05-08 07:16:32,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faeacae18d38d4eb002d9b 2026-05-08 07:16:32,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:16:32,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeacae18d38d4eb002d9b HTTP/1.1" 200 None 2026-05-08 07:16:32,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:16:32,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:16:32,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:16:32,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faeacae18d38d4eb002d9b HTTP/1.1" 200 None 2026-05-08 07:16:32,384 - lava_callback - ERROR - Error processing callback for node 69faeacae18d38d4eb002d9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47758 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:17:12,397 - lava_callback - INFO - Received callback for node 69faeaeee18d38d4eb002dae INFO: 172.20.0.1:35380 - "POST /node/69faeaeee18d38d4eb002dae HTTP/1.0" 202 Accepted 2026-05-08 07:17:12,405 - lava_callback - INFO - Starting async job submit for node 69faeaeee18d38d4eb002dae 2026-05-08 07:17:12,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:17:12,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeaeee18d38d4eb002dae HTTP/1.1" 200 None 2026-05-08 07:17:12,423 - lava_callback - DEBUG - Processing node 69faeaeee18d38d4eb002dae: baseline-arm-clabbe 2026-05-08 07:17:12,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faeaeee18d38d4eb002dae 2026-05-08 07:17:12,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:17:12,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeaeee18d38d4eb002dae HTTP/1.1" 200 None 2026-05-08 07:17:12,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:17:12,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:17:12,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:17:12,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faeaeee18d38d4eb002dae HTTP/1.1" 200 None 2026-05-08 07:17:12,476 - lava_callback - ERROR - Error processing callback for node 69faeaeee18d38d4eb002dae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:18:32,444 - lava_callback - INFO - Received callback for node 69faeb36e18d38d4eb002dc9 INFO: 172.20.0.1:58806 - "POST /node/69faeb36e18d38d4eb002dc9 HTTP/1.0" 202 Accepted 2026-05-08 07:18:32,450 - lava_callback - INFO - Starting async job submit for node 69faeb36e18d38d4eb002dc9 2026-05-08 07:18:32,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:18:32,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeb36e18d38d4eb002dc9 HTTP/1.1" 200 None 2026-05-08 07:18:32,466 - lava_callback - DEBUG - Processing node 69faeb36e18d38d4eb002dc9: baseline-arm-clabbe 2026-05-08 07:18:32,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faeb36e18d38d4eb002dc9 2026-05-08 07:18:32,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:18:32,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeb36e18d38d4eb002dc9 HTTP/1.1" 200 None 2026-05-08 07:18:32,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:18:32,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:18:32,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:18:32,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faeb36e18d38d4eb002dc9 HTTP/1.1" 200 None 2026-05-08 07:18:32,532 - lava_callback - ERROR - Error processing callback for node 69faeb36e18d38d4eb002dc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53162 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:19:12,457 - lava_callback - INFO - Received callback for node 69faeb5be18d38d4eb002dde INFO: 172.20.0.1:59156 - "POST /node/69faeb5be18d38d4eb002dde HTTP/1.0" 202 Accepted 2026-05-08 07:19:12,466 - lava_callback - INFO - Starting async job submit for node 69faeb5be18d38d4eb002dde 2026-05-08 07:19:12,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:19:12,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeb5be18d38d4eb002dde HTTP/1.1" 200 None 2026-05-08 07:19:12,481 - lava_callback - DEBUG - Processing node 69faeb5be18d38d4eb002dde: baseline-arm-clabbe 2026-05-08 07:19:12,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faeb5be18d38d4eb002dde 2026-05-08 07:19:12,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:19:12,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeb5be18d38d4eb002dde HTTP/1.1" 200 None 2026-05-08 07:19:12,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:19:12,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:19:12,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:19:12,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faeb5be18d38d4eb002dde HTTP/1.1" 200 None 2026-05-08 07:19:12,553 - lava_callback - ERROR - Error processing callback for node 69faeb5be18d38d4eb002dde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50628 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:19:32,609 - lava_callback - INFO - Received callback for node 69faeb80e18d38d4eb002df9 INFO: 172.20.0.1:32990 - "POST /node/69faeb80e18d38d4eb002df9 HTTP/1.0" 202 Accepted 2026-05-08 07:19:32,617 - lava_callback - INFO - Starting async job submit for node 69faeb80e18d38d4eb002df9 2026-05-08 07:19:32,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:19:32,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeb80e18d38d4eb002df9 HTTP/1.1" 200 None 2026-05-08 07:19:32,636 - lava_callback - DEBUG - Processing node 69faeb80e18d38d4eb002df9: baseline-arm-clabbe 2026-05-08 07:19:32,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faeb80e18d38d4eb002df9 2026-05-08 07:19:32,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:19:32,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeb80e18d38d4eb002df9 HTTP/1.1" 200 None 2026-05-08 07:19:32,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:19:32,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:19:32,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:19:32,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faeb80e18d38d4eb002df9 HTTP/1.1" 200 None 2026-05-08 07:19:32,710 - lava_callback - ERROR - Error processing callback for node 69faeb80e18d38d4eb002df9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57900 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:20:21,382 - lava_callback - INFO - Received callback for node 69faebabe18d38d4eb002e02 INFO: 172.20.0.1:43110 - "POST /node/69faebabe18d38d4eb002e02 HTTP/1.0" 202 Accepted 2026-05-08 07:20:21,388 - lava_callback - INFO - Starting async job submit for node 69faebabe18d38d4eb002e02 2026-05-08 07:20:21,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:20:21,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faebabe18d38d4eb002e02 HTTP/1.1" 200 None 2026-05-08 07:20:21,407 - lava_callback - DEBUG - Processing node 69faebabe18d38d4eb002e02: baseline-arm64-baylibre 2026-05-08 07:20:21,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faebabe18d38d4eb002e02 2026-05-08 07:20:21,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:20:21,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faebabe18d38d4eb002e02 HTTP/1.1" 200 None 2026-05-08 07:20:21,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:20:21,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:20:21,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:20:21,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faebabe18d38d4eb002e02 HTTP/1.1" 200 None 2026-05-08 07:20:21,471 - lava_callback - ERROR - Error processing callback for node 69faebabe18d38d4eb002e02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:21:32,592 - lava_callback - INFO - Received callback for node 69faebf1e18d38d4eb002e22 INFO: 172.20.0.1:37320 - "POST /node/69faebf1e18d38d4eb002e22 HTTP/1.0" 202 Accepted 2026-05-08 07:21:32,597 - lava_callback - INFO - Starting async job submit for node 69faebf1e18d38d4eb002e22 2026-05-08 07:21:32,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:21:32,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faebf1e18d38d4eb002e22 HTTP/1.1" 200 None 2026-05-08 07:21:32,612 - lava_callback - DEBUG - Processing node 69faebf1e18d38d4eb002e22: baseline-arm-clabbe 2026-05-08 07:21:32,612 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faebf1e18d38d4eb002e22 2026-05-08 07:21:32,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:21:32,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faebf1e18d38d4eb002e22 HTTP/1.1" 200 None 2026-05-08 07:21:32,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:21:32,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:21:32,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:21:32,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faebf1e18d38d4eb002e22 HTTP/1.1" 200 None 2026-05-08 07:21:32,664 - lava_callback - ERROR - Error processing callback for node 69faebf1e18d38d4eb002e22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46198 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:22:12,590 - lava_callback - INFO - Received callback for node 69faec18e18d38d4eb002e40 INFO: 172.20.0.1:36650 - "POST /node/69faec18e18d38d4eb002e40 HTTP/1.0" 202 Accepted 2026-05-08 07:22:12,595 - lava_callback - INFO - Starting async job submit for node 69faec18e18d38d4eb002e40 2026-05-08 07:22:12,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:22:12,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faec18e18d38d4eb002e40 HTTP/1.1" 200 None 2026-05-08 07:22:12,613 - lava_callback - DEBUG - Processing node 69faec18e18d38d4eb002e40: baseline-arm-clabbe 2026-05-08 07:22:12,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faec18e18d38d4eb002e40 2026-05-08 07:22:12,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:22:12,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faec18e18d38d4eb002e40 HTTP/1.1" 200 None 2026-05-08 07:22:12,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:22:12,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:22:12,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:22:12,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faec18e18d38d4eb002e40 HTTP/1.1" 200 None 2026-05-08 07:22:12,667 - lava_callback - ERROR - Error processing callback for node 69faec18e18d38d4eb002e40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49106 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:23:01,515 - lava_callback - INFO - Received callback for node 69faec44e18d38d4eb002e49 INFO: 172.20.0.1:33788 - "POST /node/69faec44e18d38d4eb002e49 HTTP/1.0" 202 Accepted 2026-05-08 07:23:01,521 - lava_callback - INFO - Starting async job submit for node 69faec44e18d38d4eb002e49 2026-05-08 07:23:01,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:23:01,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faec44e18d38d4eb002e49 HTTP/1.1" 200 None 2026-05-08 07:23:01,540 - lava_callback - DEBUG - Processing node 69faec44e18d38d4eb002e49: baseline-arm64-baylibre 2026-05-08 07:23:01,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faec44e18d38d4eb002e49 2026-05-08 07:23:01,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:23:01,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faec44e18d38d4eb002e49 HTTP/1.1" 200 None 2026-05-08 07:23:01,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:23:01,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:23:01,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:23:01,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faec44e18d38d4eb002e49 HTTP/1.1" 200 None 2026-05-08 07:23:01,588 - lava_callback - ERROR - Error processing callback for node 69faec44e18d38d4eb002e49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:24:12,730 - lava_callback - INFO - Received callback for node 69faec8ae18d38d4eb002e6c INFO: 172.20.0.1:55384 - "POST /node/69faec8ae18d38d4eb002e6c HTTP/1.0" 202 Accepted 2026-05-08 07:24:12,736 - lava_callback - INFO - Starting async job submit for node 69faec8ae18d38d4eb002e6c 2026-05-08 07:24:12,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:24:12,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faec8ae18d38d4eb002e6c HTTP/1.1" 200 None 2026-05-08 07:24:12,750 - lava_callback - DEBUG - Processing node 69faec8ae18d38d4eb002e6c: baseline-arm-clabbe 2026-05-08 07:24:12,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faec8ae18d38d4eb002e6c 2026-05-08 07:24:12,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:24:12,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faec8ae18d38d4eb002e6c HTTP/1.1" 200 None 2026-05-08 07:24:12,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:24:12,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:24:12,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:24:12,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faec8ae18d38d4eb002e6c HTTP/1.1" 200 None 2026-05-08 07:24:12,800 - lava_callback - ERROR - Error processing callback for node 69faec8ae18d38d4eb002e6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45034 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:24:41,518 - lava_callback - INFO - Received callback for node 69faecb6e18d38d4eb002e81 INFO: 172.20.0.1:37012 - "POST /node/69faecb6e18d38d4eb002e81 HTTP/1.0" 202 Accepted 2026-05-08 07:24:41,524 - lava_callback - INFO - Starting async job submit for node 69faecb6e18d38d4eb002e81 2026-05-08 07:24:41,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:24:41,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faecb6e18d38d4eb002e81 HTTP/1.1" 200 None 2026-05-08 07:24:41,542 - lava_callback - DEBUG - Processing node 69faecb6e18d38d4eb002e81: baseline-arm64-baylibre 2026-05-08 07:24:41,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faecb6e18d38d4eb002e81 2026-05-08 07:24:41,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:24:41,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faecb6e18d38d4eb002e81 HTTP/1.1" 200 None 2026-05-08 07:24:41,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:24:41,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:24:41,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:24:41,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faecb6e18d38d4eb002e81 HTTP/1.1" 200 None 2026-05-08 07:24:41,600 - lava_callback - ERROR - Error processing callback for node 69faecb6e18d38d4eb002e81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37772 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:26:12,875 - lava_callback - INFO - Received callback for node 69faecffe18d38d4eb002ea1 INFO: 172.20.0.1:51900 - "POST /node/69faecffe18d38d4eb002ea1 HTTP/1.0" 202 Accepted 2026-05-08 07:26:12,880 - lava_callback - INFO - Starting async job submit for node 69faecffe18d38d4eb002ea1 2026-05-08 07:26:12,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:26:12,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faecffe18d38d4eb002ea1 HTTP/1.1" 200 None 2026-05-08 07:26:12,897 - lava_callback - DEBUG - Processing node 69faecffe18d38d4eb002ea1: baseline-arm-clabbe 2026-05-08 07:26:12,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faecffe18d38d4eb002ea1 2026-05-08 07:26:12,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:26:12,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faecffe18d38d4eb002ea1 HTTP/1.1" 200 None 2026-05-08 07:26:12,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:26:12,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-08 07:26:12,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:26:12,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faecffe18d38d4eb002ea1 HTTP/1.1" 200 None 2026-05-08 07:26:12,943 - lava_callback - ERROR - Error processing callback for node 69faecffe18d38d4eb002ea1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44872 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:31:42,016 - lava_callback - INFO - Received callback for node 69faee4de18d38d4eb002f3e INFO: 172.20.0.1:60908 - "POST /node/69faee4de18d38d4eb002f3e HTTP/1.0" 202 Accepted 2026-05-08 07:31:42,022 - lava_callback - INFO - Starting async job submit for node 69faee4de18d38d4eb002f3e 2026-05-08 07:31:42,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:31:42,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faee4de18d38d4eb002f3e HTTP/1.1" 200 None 2026-05-08 07:31:42,037 - lava_callback - DEBUG - Processing node 69faee4de18d38d4eb002f3e: baseline-arm64-baylibre 2026-05-08 07:31:42,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faee4de18d38d4eb002f3e 2026-05-08 07:31:42,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:31:42,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faee4de18d38d4eb002f3e HTTP/1.1" 200 None 2026-05-08 07:31:42,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:31:42,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:31:42,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:31:42,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faee4de18d38d4eb002f3e HTTP/1.1" 200 None 2026-05-08 07:31:42,093 - lava_callback - ERROR - Error processing callback for node 69faee4de18d38d4eb002f3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53586 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:32:41,935 - lava_callback - INFO - Received callback for node 69faee97e18d38d4eb002f65 INFO: 172.20.0.1:54200 - "POST /node/69faee97e18d38d4eb002f65 HTTP/1.0" 202 Accepted 2026-05-08 07:32:41,941 - lava_callback - INFO - Starting async job submit for node 69faee97e18d38d4eb002f65 2026-05-08 07:32:41,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:32:41,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faee97e18d38d4eb002f65 HTTP/1.1" 200 None 2026-05-08 07:32:41,956 - lava_callback - DEBUG - Processing node 69faee97e18d38d4eb002f65: baseline-arm64-baylibre 2026-05-08 07:32:41,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faee97e18d38d4eb002f65 2026-05-08 07:32:41,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:32:41,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faee97e18d38d4eb002f65 HTTP/1.1" 200 None 2026-05-08 07:32:41,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:32:41,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:32:41,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:32:42,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faee97e18d38d4eb002f65 HTTP/1.1" 200 None 2026-05-08 07:32:42,003 - lava_callback - ERROR - Error processing callback for node 69faee97e18d38d4eb002f65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43206 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:34:02,059 - lava_callback - INFO - Received callback for node 69faeee1e18d38d4eb002f84 INFO: 172.20.0.1:60646 - "POST /node/69faeee1e18d38d4eb002f84 HTTP/1.0" 202 Accepted 2026-05-08 07:34:02,066 - lava_callback - INFO - Starting async job submit for node 69faeee1e18d38d4eb002f84 2026-05-08 07:34:02,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:34:02,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeee1e18d38d4eb002f84 HTTP/1.1" 200 None 2026-05-08 07:34:02,085 - lava_callback - DEBUG - Processing node 69faeee1e18d38d4eb002f84: baseline-arm64-baylibre 2026-05-08 07:34:02,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faeee1e18d38d4eb002f84 2026-05-08 07:34:02,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:34:02,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faeee1e18d38d4eb002f84 HTTP/1.1" 200 None 2026-05-08 07:34:02,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:34:02,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:34:02,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:34:02,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faeee1e18d38d4eb002f84 HTTP/1.1" 200 None 2026-05-08 07:34:02,142 - lava_callback - ERROR - Error processing callback for node 69faeee1e18d38d4eb002f84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56956 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:35:13,198 - lava_callback - INFO - Received callback for node 69faef24e18d38d4eb002fac INFO: 172.20.0.1:44098 - "POST /node/69faef24e18d38d4eb002fac HTTP/1.0" 202 Accepted 2026-05-08 07:35:13,208 - lava_callback - INFO - Starting async job submit for node 69faef24e18d38d4eb002fac 2026-05-08 07:35:13,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:35:13,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faef24e18d38d4eb002fac HTTP/1.1" 200 None 2026-05-08 07:35:13,229 - lava_callback - DEBUG - Processing node 69faef24e18d38d4eb002fac: baseline-arm-clabbe 2026-05-08 07:35:13,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faef24e18d38d4eb002fac 2026-05-08 07:35:13,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:35:13,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faef24e18d38d4eb002fac HTTP/1.1" 200 None 2026-05-08 07:35:13,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:35:13,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 07:35:13,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:35:13,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faef24e18d38d4eb002fac HTTP/1.1" 200 None 2026-05-08 07:35:13,290 - lava_callback - ERROR - Error processing callback for node 69faef24e18d38d4eb002fac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42682 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:36:02,239 - lava_callback - INFO - Received callback for node 69faef50e18d38d4eb002fb7 INFO: 172.20.0.1:41808 - "POST /node/69faef50e18d38d4eb002fb7 HTTP/1.0" 202 Accepted 2026-05-08 07:36:02,245 - lava_callback - INFO - Starting async job submit for node 69faef50e18d38d4eb002fb7 2026-05-08 07:36:02,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:36:02,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faef50e18d38d4eb002fb7 HTTP/1.1" 200 None 2026-05-08 07:36:02,260 - lava_callback - DEBUG - Processing node 69faef50e18d38d4eb002fb7: baseline-arm64-baylibre 2026-05-08 07:36:02,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faef50e18d38d4eb002fb7 2026-05-08 07:36:02,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:36:02,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faef50e18d38d4eb002fb7 HTTP/1.1" 200 None 2026-05-08 07:36:02,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:36:02,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:36:02,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:36:02,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faef50e18d38d4eb002fb7 HTTP/1.1" 200 None 2026-05-08 07:36:02,316 - lava_callback - ERROR - Error processing callback for node 69faef50e18d38d4eb002fb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33962 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:37:02,244 - lava_callback - INFO - Received callback for node 69faef9be18d38d4eb002fde INFO: 172.20.0.1:40026 - "POST /node/69faef9be18d38d4eb002fde HTTP/1.0" 202 Accepted 2026-05-08 07:37:02,250 - lava_callback - INFO - Starting async job submit for node 69faef9be18d38d4eb002fde 2026-05-08 07:37:02,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:37:02,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faef9be18d38d4eb002fde HTTP/1.1" 200 None 2026-05-08 07:37:02,265 - lava_callback - DEBUG - Processing node 69faef9be18d38d4eb002fde: baseline-arm64-baylibre 2026-05-08 07:37:02,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faef9be18d38d4eb002fde 2026-05-08 07:37:02,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:37:02,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faef9be18d38d4eb002fde HTTP/1.1" 200 None 2026-05-08 07:37:02,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:37:02,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:37:02,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:37:02,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faef9be18d38d4eb002fde HTTP/1.1" 200 None 2026-05-08 07:37:02,314 - lava_callback - ERROR - Error processing callback for node 69faef9be18d38d4eb002fde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38734 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:38:22,308 - lava_callback - INFO - Received callback for node 69faefe3e18d38d4eb002ffe INFO: 172.20.0.1:35680 - "POST /node/69faefe3e18d38d4eb002ffe HTTP/1.0" 202 Accepted 2026-05-08 07:38:22,314 - lava_callback - INFO - Starting async job submit for node 69faefe3e18d38d4eb002ffe 2026-05-08 07:38:22,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:38:22,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faefe3e18d38d4eb002ffe HTTP/1.1" 200 None 2026-05-08 07:38:22,331 - lava_callback - DEBUG - Processing node 69faefe3e18d38d4eb002ffe: baseline-arm64-baylibre 2026-05-08 07:38:22,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faefe3e18d38d4eb002ffe 2026-05-08 07:38:22,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:38:22,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faefe3e18d38d4eb002ffe HTTP/1.1" 200 None 2026-05-08 07:38:22,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:38:22,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:38:22,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:38:22,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faefe3e18d38d4eb002ffe HTTP/1.1" 200 None 2026-05-08 07:38:22,379 - lava_callback - ERROR - Error processing callback for node 69faefe3e18d38d4eb002ffe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43054 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:39:42,392 - lava_callback - INFO - Received callback for node 69faf02fe18d38d4eb00301f INFO: 172.20.0.1:43068 - "POST /node/69faf02fe18d38d4eb00301f HTTP/1.0" 202 Accepted 2026-05-08 07:39:42,400 - lava_callback - INFO - Starting async job submit for node 69faf02fe18d38d4eb00301f 2026-05-08 07:39:42,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:39:42,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf02fe18d38d4eb00301f HTTP/1.1" 200 None 2026-05-08 07:39:42,417 - lava_callback - DEBUG - Processing node 69faf02fe18d38d4eb00301f: baseline-arm64-baylibre 2026-05-08 07:39:42,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf02fe18d38d4eb00301f 2026-05-08 07:39:42,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:39:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf02fe18d38d4eb00301f HTTP/1.1" 200 None 2026-05-08 07:39:42,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:39:42,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:39:42,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:39:42,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf02fe18d38d4eb00301f HTTP/1.1" 200 None 2026-05-08 07:39:42,486 - lava_callback - ERROR - Error processing callback for node 69faf02fe18d38d4eb00301f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59586 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:40:53,470 - lava_callback - INFO - Received callback for node 69faf07ee18d38d4eb003047 INFO: 172.20.0.1:56264 - "POST /node/69faf07ee18d38d4eb003047 HTTP/1.0" 202 Accepted 2026-05-08 07:40:53,475 - lava_callback - INFO - Starting async job submit for node 69faf07ee18d38d4eb003047 2026-05-08 07:40:53,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:40:53,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf07ee18d38d4eb003047 HTTP/1.1" 200 None 2026-05-08 07:40:53,491 - lava_callback - DEBUG - Processing node 69faf07ee18d38d4eb003047: baseline-arm64-clabbe 2026-05-08 07:40:53,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf07ee18d38d4eb003047 2026-05-08 07:40:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:40:53,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf07ee18d38d4eb003047 HTTP/1.1" 200 None 2026-05-08 07:40:53,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:40:53,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:40:53,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:40:53,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf07ee18d38d4eb003047 HTTP/1.1" 200 None 2026-05-08 07:40:53,538 - lava_callback - ERROR - Error processing callback for node 69faf07ee18d38d4eb003047: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51948 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:42:13,513 - lava_callback - INFO - Received callback for node 69faf0c9e18d38d4eb003073 INFO: 172.20.0.1:59898 - "POST /node/69faf0c9e18d38d4eb003073 HTTP/1.0" 202 Accepted 2026-05-08 07:42:13,519 - lava_callback - INFO - Starting async job submit for node 69faf0c9e18d38d4eb003073 2026-05-08 07:42:13,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:42:13,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf0c9e18d38d4eb003073 HTTP/1.1" 200 None 2026-05-08 07:42:13,534 - lava_callback - DEBUG - Processing node 69faf0c9e18d38d4eb003073: baseline-arm64-clabbe 2026-05-08 07:42:13,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf0c9e18d38d4eb003073 2026-05-08 07:42:13,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:42:13,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf0c9e18d38d4eb003073 HTTP/1.1" 200 None 2026-05-08 07:42:13,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:42:13,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:42:13,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:42:13,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf0c9e18d38d4eb003073 HTTP/1.1" 200 None 2026-05-08 07:42:13,591 - lava_callback - ERROR - Error processing callback for node 69faf0c9e18d38d4eb003073: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47876 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:43:33,532 - lava_callback - INFO - Received callback for node 69faf113e18d38d4eb003090 INFO: 172.20.0.1:43476 - "POST /node/69faf113e18d38d4eb003090 HTTP/1.0" 202 Accepted 2026-05-08 07:43:33,538 - lava_callback - INFO - Starting async job submit for node 69faf113e18d38d4eb003090 2026-05-08 07:43:33,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:43:33,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf113e18d38d4eb003090 HTTP/1.1" 200 None 2026-05-08 07:43:33,558 - lava_callback - DEBUG - Processing node 69faf113e18d38d4eb003090: baseline-arm64-clabbe 2026-05-08 07:43:33,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf113e18d38d4eb003090 2026-05-08 07:43:33,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:43:33,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf113e18d38d4eb003090 HTTP/1.1" 200 None 2026-05-08 07:43:33,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:43:33,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:43:33,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:43:33,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf113e18d38d4eb003090 HTTP/1.1" 200 None 2026-05-08 07:43:33,619 - lava_callback - ERROR - Error processing callback for node 69faf113e18d38d4eb003090: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49972 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:44:33,633 - lava_callback - INFO - Received callback for node 69faf15ee18d38d4eb0030bf INFO: 172.20.0.1:36360 - "POST /node/69faf15ee18d38d4eb0030bf HTTP/1.0" 202 Accepted 2026-05-08 07:44:33,642 - lava_callback - INFO - Starting async job submit for node 69faf15ee18d38d4eb0030bf 2026-05-08 07:44:33,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:44:33,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf15ee18d38d4eb0030bf HTTP/1.1" 200 None 2026-05-08 07:44:33,671 - lava_callback - DEBUG - Processing node 69faf15ee18d38d4eb0030bf: baseline-arm64-clabbe 2026-05-08 07:44:33,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf15ee18d38d4eb0030bf 2026-05-08 07:44:33,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:44:33,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf15ee18d38d4eb0030bf HTTP/1.1" 200 None 2026-05-08 07:44:33,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:44:33,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:44:33,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:44:33,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf15ee18d38d4eb0030bf HTTP/1.1" 200 None 2026-05-08 07:44:33,734 - lava_callback - ERROR - Error processing callback for node 69faf15ee18d38d4eb0030bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54168 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:45:53,656 - lava_callback - INFO - Received callback for node 69faf1a8e18d38d4eb0030da INFO: 172.20.0.1:45460 - "POST /node/69faf1a8e18d38d4eb0030da HTTP/1.0" 202 Accepted 2026-05-08 07:45:53,661 - lava_callback - INFO - Starting async job submit for node 69faf1a8e18d38d4eb0030da 2026-05-08 07:45:53,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:45:53,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf1a8e18d38d4eb0030da HTTP/1.1" 200 None 2026-05-08 07:45:53,677 - lava_callback - DEBUG - Processing node 69faf1a8e18d38d4eb0030da: baseline-arm64-clabbe 2026-05-08 07:45:53,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf1a8e18d38d4eb0030da 2026-05-08 07:45:53,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:45:53,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf1a8e18d38d4eb0030da HTTP/1.1" 200 None 2026-05-08 07:45:53,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:45:53,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:45:53,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:45:53,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf1a8e18d38d4eb0030da HTTP/1.1" 200 None 2026-05-08 07:45:53,724 - lava_callback - ERROR - Error processing callback for node 69faf1a8e18d38d4eb0030da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60004 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:47:13,711 - lava_callback - INFO - Received callback for node 69faf1f1e18d38d4eb0030fd INFO: 172.20.0.1:36872 - "POST /node/69faf1f1e18d38d4eb0030fd HTTP/1.0" 202 Accepted 2026-05-08 07:47:13,717 - lava_callback - INFO - Starting async job submit for node 69faf1f1e18d38d4eb0030fd 2026-05-08 07:47:13,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:47:13,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf1f1e18d38d4eb0030fd HTTP/1.1" 200 None 2026-05-08 07:47:13,750 - lava_callback - DEBUG - Processing node 69faf1f1e18d38d4eb0030fd: baseline-arm64-clabbe 2026-05-08 07:47:13,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf1f1e18d38d4eb0030fd 2026-05-08 07:47:13,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:47:13,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf1f1e18d38d4eb0030fd HTTP/1.1" 200 None 2026-05-08 07:47:13,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:47:13,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 07:47:13,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:47:13,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf1f1e18d38d4eb0030fd HTTP/1.1" 200 None 2026-05-08 07:47:13,821 - lava_callback - ERROR - Error processing callback for node 69faf1f1e18d38d4eb0030fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35022 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:48:23,089 - lava_callback - INFO - Received callback for node 69faf234e18d38d4eb003124 INFO: 172.20.0.1:39090 - "POST /node/69faf234e18d38d4eb003124 HTTP/1.0" 202 Accepted 2026-05-08 07:48:23,095 - lava_callback - INFO - Starting async job submit for node 69faf234e18d38d4eb003124 2026-05-08 07:48:23,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:48:23,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf234e18d38d4eb003124 HTTP/1.1" 200 None 2026-05-08 07:48:23,110 - lava_callback - DEBUG - Processing node 69faf234e18d38d4eb003124: baseline-arm64-baylibre 2026-05-08 07:48:23,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf234e18d38d4eb003124 2026-05-08 07:48:23,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:48:23,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf234e18d38d4eb003124 HTTP/1.1" 200 None 2026-05-08 07:48:23,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:48:23,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:48:23,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:48:23,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf234e18d38d4eb003124 HTTP/1.1" 200 None 2026-05-08 07:48:23,161 - lava_callback - ERROR - Error processing callback for node 69faf234e18d38d4eb003124: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51290 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:49:22,871 - lava_callback - INFO - Received callback for node 69faf27de18d38d4eb003145 INFO: 172.20.0.1:60838 - "POST /node/69faf27de18d38d4eb003145 HTTP/1.0" 202 Accepted 2026-05-08 07:49:22,878 - lava_callback - INFO - Starting async job submit for node 69faf27de18d38d4eb003145 2026-05-08 07:49:22,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:49:22,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf27de18d38d4eb003145 HTTP/1.1" 200 None 2026-05-08 07:49:22,899 - lava_callback - DEBUG - Processing node 69faf27de18d38d4eb003145: baseline-arm64-baylibre 2026-05-08 07:49:22,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf27de18d38d4eb003145 2026-05-08 07:49:22,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:49:22,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf27de18d38d4eb003145 HTTP/1.1" 200 None 2026-05-08 07:49:22,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:49:22,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:49:22,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:49:22,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf27de18d38d4eb003145 HTTP/1.1" 200 None 2026-05-08 07:49:22,960 - lava_callback - ERROR - Error processing callback for node 69faf27de18d38d4eb003145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33018 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:50:43,177 - lava_callback - INFO - Received callback for node 69faf2c8e18d38d4eb00316c INFO: 172.20.0.1:33034 - "POST /node/69faf2c8e18d38d4eb00316c HTTP/1.0" 202 Accepted 2026-05-08 07:50:43,183 - lava_callback - INFO - Starting async job submit for node 69faf2c8e18d38d4eb00316c 2026-05-08 07:50:43,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:50:43,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf2c8e18d38d4eb00316c HTTP/1.1" 200 None 2026-05-08 07:50:43,207 - lava_callback - DEBUG - Processing node 69faf2c8e18d38d4eb00316c: baseline-arm64-baylibre 2026-05-08 07:50:43,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf2c8e18d38d4eb00316c 2026-05-08 07:50:43,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:50:43,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf2c8e18d38d4eb00316c HTTP/1.1" 200 None 2026-05-08 07:50:43,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:50:43,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:50:43,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:50:43,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf2c8e18d38d4eb00316c HTTP/1.1" 200 None 2026-05-08 07:50:43,257 - lava_callback - ERROR - Error processing callback for node 69faf2c8e18d38d4eb00316c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33206 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:52:03,091 - lava_callback - INFO - Received callback for node 69faf311e18d38d4eb003191 INFO: 172.20.0.1:47778 - "POST /node/69faf311e18d38d4eb003191 HTTP/1.0" 202 Accepted 2026-05-08 07:52:03,097 - lava_callback - INFO - Starting async job submit for node 69faf311e18d38d4eb003191 2026-05-08 07:52:03,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:52:03,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf311e18d38d4eb003191 HTTP/1.1" 200 None 2026-05-08 07:52:03,130 - lava_callback - DEBUG - Processing node 69faf311e18d38d4eb003191: baseline-arm64-baylibre 2026-05-08 07:52:03,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf311e18d38d4eb003191 2026-05-08 07:52:03,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:52:03,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf311e18d38d4eb003191 HTTP/1.1" 200 None 2026-05-08 07:52:03,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:52:03,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:52:03,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:52:03,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf311e18d38d4eb003191 HTTP/1.1" 200 None 2026-05-08 07:52:03,198 - lava_callback - ERROR - Error processing callback for node 69faf311e18d38d4eb003191: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56600 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:53:03,093 - lava_callback - INFO - Received callback for node 69faf35ae18d38d4eb0031b3 INFO: 172.20.0.1:41110 - "POST /node/69faf35ae18d38d4eb0031b3 HTTP/1.0" 202 Accepted 2026-05-08 07:53:03,099 - lava_callback - INFO - Starting async job submit for node 69faf35ae18d38d4eb0031b3 2026-05-08 07:53:03,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:53:03,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf35ae18d38d4eb0031b3 HTTP/1.1" 200 None 2026-05-08 07:53:03,114 - lava_callback - DEBUG - Processing node 69faf35ae18d38d4eb0031b3: baseline-arm64-baylibre 2026-05-08 07:53:03,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf35ae18d38d4eb0031b3 2026-05-08 07:53:03,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:53:03,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf35ae18d38d4eb0031b3 HTTP/1.1" 200 None 2026-05-08 07:53:03,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:53:03,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:53:03,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:53:03,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf35ae18d38d4eb0031b3 HTTP/1.1" 200 None 2026-05-08 07:53:03,165 - lava_callback - ERROR - Error processing callback for node 69faf35ae18d38d4eb0031b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54480 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:54:23,349 - lava_callback - INFO - Received callback for node 69faf3a5e18d38d4eb0031db INFO: 172.20.0.1:46816 - "POST /node/69faf3a5e18d38d4eb0031db HTTP/1.0" 202 Accepted 2026-05-08 07:54:23,355 - lava_callback - INFO - Starting async job submit for node 69faf3a5e18d38d4eb0031db 2026-05-08 07:54:23,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:54:23,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf3a5e18d38d4eb0031db HTTP/1.1" 200 None 2026-05-08 07:54:23,381 - lava_callback - DEBUG - Processing node 69faf3a5e18d38d4eb0031db: baseline-arm64-baylibre 2026-05-08 07:54:23,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf3a5e18d38d4eb0031db 2026-05-08 07:54:23,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:54:23,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf3a5e18d38d4eb0031db HTTP/1.1" 200 None 2026-05-08 07:54:23,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:54:23,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:54:23,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:54:23,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf3a5e18d38d4eb0031db HTTP/1.1" 200 None 2026-05-08 07:54:23,434 - lava_callback - ERROR - Error processing callback for node 69faf3a5e18d38d4eb0031db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52750 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:55:43,239 - lava_callback - INFO - Received callback for node 69faf3efe18d38d4eb0031fa INFO: 172.20.0.1:52752 - "POST /node/69faf3efe18d38d4eb0031fa HTTP/1.0" 202 Accepted 2026-05-08 07:55:43,245 - lava_callback - INFO - Starting async job submit for node 69faf3efe18d38d4eb0031fa 2026-05-08 07:55:43,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:55:43,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf3efe18d38d4eb0031fa HTTP/1.1" 200 None 2026-05-08 07:55:43,271 - lava_callback - DEBUG - Processing node 69faf3efe18d38d4eb0031fa: baseline-arm64-baylibre 2026-05-08 07:55:43,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf3efe18d38d4eb0031fa 2026-05-08 07:55:43,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:55:43,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf3efe18d38d4eb0031fa HTTP/1.1" 200 None 2026-05-08 07:55:43,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:55:43,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:55:43,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:55:43,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf3efe18d38d4eb0031fa HTTP/1.1" 200 None 2026-05-08 07:55:43,323 - lava_callback - ERROR - Error processing callback for node 69faf3efe18d38d4eb0031fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49774 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:56:43,296 - lava_callback - INFO - Received callback for node 69faf436e18d38d4eb00321e INFO: 172.20.0.1:49790 - "POST /node/69faf436e18d38d4eb00321e HTTP/1.0" 202 Accepted 2026-05-08 07:56:43,304 - lava_callback - INFO - Starting async job submit for node 69faf436e18d38d4eb00321e 2026-05-08 07:56:43,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:56:43,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf436e18d38d4eb00321e HTTP/1.1" 200 None 2026-05-08 07:56:43,319 - lava_callback - DEBUG - Processing node 69faf436e18d38d4eb00321e: baseline-arm64-baylibre 2026-05-08 07:56:43,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf436e18d38d4eb00321e 2026-05-08 07:56:43,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:56:43,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf436e18d38d4eb00321e HTTP/1.1" 200 None 2026-05-08 07:56:43,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:56:43,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:56:43,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:56:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf436e18d38d4eb00321e HTTP/1.1" 200 None 2026-05-08 07:56:43,377 - lava_callback - ERROR - Error processing callback for node 69faf436e18d38d4eb00321e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55132 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:58:03,392 - lava_callback - INFO - Received callback for node 69faf480e18d38d4eb00323b INFO: 172.20.0.1:40808 - "POST /node/69faf480e18d38d4eb00323b HTTP/1.0" 202 Accepted 2026-05-08 07:58:03,399 - lava_callback - INFO - Starting async job submit for node 69faf480e18d38d4eb00323b 2026-05-08 07:58:03,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:58:03,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf480e18d38d4eb00323b HTTP/1.1" 200 None 2026-05-08 07:58:03,419 - lava_callback - DEBUG - Processing node 69faf480e18d38d4eb00323b: baseline-arm64-baylibre 2026-05-08 07:58:03,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf480e18d38d4eb00323b 2026-05-08 07:58:03,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:58:03,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf480e18d38d4eb00323b HTTP/1.1" 200 None 2026-05-08 07:58:03,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:58:03,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:58:03,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:58:03,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf480e18d38d4eb00323b HTTP/1.1" 200 None 2026-05-08 07:58:03,486 - lava_callback - ERROR - Error processing callback for node 69faf480e18d38d4eb00323b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33222 - "GET / HTTP/1.0" 200 OK 2026-05-08 07:59:23,471 - lava_callback - INFO - Received callback for node 69faf4cae18d38d4eb00325c INFO: 172.20.0.1:59538 - "POST /node/69faf4cae18d38d4eb00325c HTTP/1.0" 202 Accepted 2026-05-08 07:59:23,476 - lava_callback - INFO - Starting async job submit for node 69faf4cae18d38d4eb00325c 2026-05-08 07:59:23,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:59:23,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf4cae18d38d4eb00325c HTTP/1.1" 200 None 2026-05-08 07:59:23,491 - lava_callback - DEBUG - Processing node 69faf4cae18d38d4eb00325c: baseline-arm64-baylibre 2026-05-08 07:59:23,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf4cae18d38d4eb00325c 2026-05-08 07:59:23,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:59:23,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf4cae18d38d4eb00325c HTTP/1.1" 200 None 2026-05-08 07:59:23,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:59:23,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 07:59:23,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 07:59:23,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf4cae18d38d4eb00325c HTTP/1.1" 200 None 2026-05-08 07:59:23,546 - lava_callback - ERROR - Error processing callback for node 69faf4cae18d38d4eb00325c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47710 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:00:23,494 - lava_callback - INFO - Received callback for node 69faf515e18d38d4eb003279 INFO: 172.20.0.1:53968 - "POST /node/69faf515e18d38d4eb003279 HTTP/1.0" 202 Accepted 2026-05-08 08:00:23,500 - lava_callback - INFO - Starting async job submit for node 69faf515e18d38d4eb003279 2026-05-08 08:00:23,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:00:23,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf515e18d38d4eb003279 HTTP/1.1" 200 None 2026-05-08 08:00:23,516 - lava_callback - DEBUG - Processing node 69faf515e18d38d4eb003279: baseline-arm64-baylibre 2026-05-08 08:00:23,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf515e18d38d4eb003279 2026-05-08 08:00:23,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:00:23,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf515e18d38d4eb003279 HTTP/1.1" 200 None 2026-05-08 08:00:23,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:00:23,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:00:23,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:00:23,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf515e18d38d4eb003279 HTTP/1.1" 200 None 2026-05-08 08:00:23,576 - lava_callback - ERROR - Error processing callback for node 69faf515e18d38d4eb003279: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39310 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:01:43,616 - lava_callback - INFO - Received callback for node 69faf560e18d38d4eb00329a INFO: 172.20.0.1:39320 - "POST /node/69faf560e18d38d4eb00329a HTTP/1.0" 202 Accepted 2026-05-08 08:01:43,624 - lava_callback - INFO - Starting async job submit for node 69faf560e18d38d4eb00329a 2026-05-08 08:01:43,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:01:43,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf560e18d38d4eb00329a HTTP/1.1" 200 None 2026-05-08 08:01:43,646 - lava_callback - DEBUG - Processing node 69faf560e18d38d4eb00329a: baseline-arm64-baylibre 2026-05-08 08:01:43,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf560e18d38d4eb00329a 2026-05-08 08:01:43,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:01:43,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf560e18d38d4eb00329a HTTP/1.1" 200 None 2026-05-08 08:01:43,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:01:43,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:01:43,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:01:43,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf560e18d38d4eb00329a HTTP/1.1" 200 None 2026-05-08 08:01:43,697 - lava_callback - ERROR - Error processing callback for node 69faf560e18d38d4eb00329a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50856 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:03:03,697 - lava_callback - INFO - Received callback for node 69faf5abe18d38d4eb0032b7 INFO: 172.20.0.1:35394 - "POST /node/69faf5abe18d38d4eb0032b7 HTTP/1.0" 202 Accepted 2026-05-08 08:03:03,703 - lava_callback - INFO - Starting async job submit for node 69faf5abe18d38d4eb0032b7 2026-05-08 08:03:03,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:03:03,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf5abe18d38d4eb0032b7 HTTP/1.1" 200 None 2026-05-08 08:03:03,725 - lava_callback - DEBUG - Processing node 69faf5abe18d38d4eb0032b7: baseline-arm64-baylibre 2026-05-08 08:03:03,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf5abe18d38d4eb0032b7 2026-05-08 08:03:03,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:03:03,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf5abe18d38d4eb0032b7 HTTP/1.1" 200 None 2026-05-08 08:03:03,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:03:03,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:03:03,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:03:03,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf5abe18d38d4eb0032b7 HTTP/1.1" 200 None 2026-05-08 08:03:03,772 - lava_callback - ERROR - Error processing callback for node 69faf5abe18d38d4eb0032b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60974 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:04:23,895 - lava_callback - INFO - Received callback for node 69faf5f6e18d38d4eb0032da INFO: 172.20.0.1:51222 - "POST /node/69faf5f6e18d38d4eb0032da HTTP/1.0" 202 Accepted 2026-05-08 08:04:23,901 - lava_callback - INFO - Starting async job submit for node 69faf5f6e18d38d4eb0032da 2026-05-08 08:04:23,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:04:23,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf5f6e18d38d4eb0032da HTTP/1.1" 200 None 2026-05-08 08:04:23,916 - lava_callback - DEBUG - Processing node 69faf5f6e18d38d4eb0032da: baseline-arm64-baylibre 2026-05-08 08:04:23,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf5f6e18d38d4eb0032da 2026-05-08 08:04:23,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:04:23,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf5f6e18d38d4eb0032da HTTP/1.1" 200 None 2026-05-08 08:04:23,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:04:23,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:04:23,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:04:23,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf5f6e18d38d4eb0032da HTTP/1.1" 200 None 2026-05-08 08:04:23,964 - lava_callback - ERROR - Error processing callback for node 69faf5f6e18d38d4eb0032da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52750 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:05:34,786 - lava_callback - INFO - Received callback for node 69faf647e18d38d4eb0032f7 INFO: 172.20.0.1:60176 - "POST /node/69faf647e18d38d4eb0032f7 HTTP/1.0" 202 Accepted 2026-05-08 08:05:34,792 - lava_callback - INFO - Starting async job submit for node 69faf647e18d38d4eb0032f7 2026-05-08 08:05:34,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:05:34,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf647e18d38d4eb0032f7 HTTP/1.1" 200 None 2026-05-08 08:05:34,807 - lava_callback - DEBUG - Processing node 69faf647e18d38d4eb0032f7: baseline-arm64-clabbe 2026-05-08 08:05:34,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf647e18d38d4eb0032f7 2026-05-08 08:05:34,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:05:34,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf647e18d38d4eb0032f7 HTTP/1.1" 200 None 2026-05-08 08:05:34,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:05:34,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:05:34,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:05:34,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf647e18d38d4eb0032f7 HTTP/1.1" 200 None 2026-05-08 08:05:34,858 - lava_callback - ERROR - Error processing callback for node 69faf647e18d38d4eb0032f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54660 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:06:54,396 - lava_callback - INFO - Received callback for node 69faf692e18d38d4eb003319 INFO: 172.20.0.1:37420 - "POST /node/69faf692e18d38d4eb003319 HTTP/1.0" 202 Accepted 2026-05-08 08:06:54,402 - lava_callback - INFO - Starting async job submit for node 69faf692e18d38d4eb003319 2026-05-08 08:06:54,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:06:54,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf692e18d38d4eb003319 HTTP/1.1" 200 None 2026-05-08 08:06:54,417 - lava_callback - DEBUG - Processing node 69faf692e18d38d4eb003319: baseline-arm64-clabbe 2026-05-08 08:06:54,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf692e18d38d4eb003319 2026-05-08 08:06:54,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:06:54,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf692e18d38d4eb003319 HTTP/1.1" 200 None 2026-05-08 08:06:54,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:06:54,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:06:54,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:06:54,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf692e18d38d4eb003319 HTTP/1.1" 200 None 2026-05-08 08:06:54,464 - lava_callback - ERROR - Error processing callback for node 69faf692e18d38d4eb003319: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55014 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:08:14,449 - lava_callback - INFO - Received callback for node 69faf6dee18d38d4eb003339 INFO: 172.20.0.1:51008 - "POST /node/69faf6dee18d38d4eb003339 HTTP/1.0" 202 Accepted 2026-05-08 08:08:14,455 - lava_callback - INFO - Starting async job submit for node 69faf6dee18d38d4eb003339 2026-05-08 08:08:14,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:08:14,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf6dee18d38d4eb003339 HTTP/1.1" 200 None 2026-05-08 08:08:14,472 - lava_callback - DEBUG - Processing node 69faf6dee18d38d4eb003339: baseline-arm64-clabbe 2026-05-08 08:08:14,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf6dee18d38d4eb003339 2026-05-08 08:08:14,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:08:14,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf6dee18d38d4eb003339 HTTP/1.1" 200 None 2026-05-08 08:08:14,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:08:14,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:08:14,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:08:14,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf6dee18d38d4eb003339 HTTP/1.1" 200 None 2026-05-08 08:08:14,520 - lava_callback - ERROR - Error processing callback for node 69faf6dee18d38d4eb003339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56854 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:09:34,503 - lava_callback - INFO - Received callback for node 69faf729e18d38d4eb00335b INFO: 172.20.0.1:58744 - "POST /node/69faf729e18d38d4eb00335b HTTP/1.0" 202 Accepted 2026-05-08 08:09:34,512 - lava_callback - INFO - Starting async job submit for node 69faf729e18d38d4eb00335b 2026-05-08 08:09:34,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:09:34,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf729e18d38d4eb00335b HTTP/1.1" 200 None 2026-05-08 08:09:34,532 - lava_callback - DEBUG - Processing node 69faf729e18d38d4eb00335b: baseline-arm64-clabbe 2026-05-08 08:09:34,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf729e18d38d4eb00335b 2026-05-08 08:09:34,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:09:34,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf729e18d38d4eb00335b HTTP/1.1" 200 None 2026-05-08 08:09:34,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:09:34,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:09:34,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:09:34,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf729e18d38d4eb00335b HTTP/1.1" 200 None 2026-05-08 08:09:34,599 - lava_callback - ERROR - Error processing callback for node 69faf729e18d38d4eb00335b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54890 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:10:34,561 - lava_callback - INFO - Received callback for node 69faf774e18d38d4eb00337b INFO: 172.20.0.1:60022 - "POST /node/69faf774e18d38d4eb00337b HTTP/1.0" 202 Accepted 2026-05-08 08:10:34,567 - lava_callback - INFO - Starting async job submit for node 69faf774e18d38d4eb00337b 2026-05-08 08:10:34,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:10:34,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf774e18d38d4eb00337b HTTP/1.1" 200 None 2026-05-08 08:10:34,582 - lava_callback - DEBUG - Processing node 69faf774e18d38d4eb00337b: baseline-arm64-clabbe 2026-05-08 08:10:34,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf774e18d38d4eb00337b 2026-05-08 08:10:34,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:10:34,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf774e18d38d4eb00337b HTTP/1.1" 200 None 2026-05-08 08:10:34,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:10:34,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:10:34,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:10:34,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf774e18d38d4eb00337b HTTP/1.1" 200 None 2026-05-08 08:10:34,632 - lava_callback - ERROR - Error processing callback for node 69faf774e18d38d4eb00337b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50864 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:11:54,612 - lava_callback - INFO - Received callback for node 69faf7bee18d38d4eb00339d INFO: 172.20.0.1:39750 - "POST /node/69faf7bee18d38d4eb00339d HTTP/1.0" 202 Accepted 2026-05-08 08:11:54,617 - lava_callback - INFO - Starting async job submit for node 69faf7bee18d38d4eb00339d 2026-05-08 08:11:54,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:11:54,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf7bee18d38d4eb00339d HTTP/1.1" 200 None 2026-05-08 08:11:54,632 - lava_callback - DEBUG - Processing node 69faf7bee18d38d4eb00339d: baseline-arm64-clabbe 2026-05-08 08:11:54,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf7bee18d38d4eb00339d 2026-05-08 08:11:54,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:11:54,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf7bee18d38d4eb00339d HTTP/1.1" 200 None 2026-05-08 08:11:54,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:11:54,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:11:54,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:11:54,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf7bee18d38d4eb00339d HTTP/1.1" 200 None 2026-05-08 08:11:54,681 - lava_callback - ERROR - Error processing callback for node 69faf7bee18d38d4eb00339d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56582 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:13:14,617 - lava_callback - INFO - Received callback for node 69faf80ae18d38d4eb0033bd INFO: 172.20.0.1:50516 - "POST /node/69faf80ae18d38d4eb0033bd HTTP/1.0" 202 Accepted 2026-05-08 08:13:14,623 - lava_callback - INFO - Starting async job submit for node 69faf80ae18d38d4eb0033bd 2026-05-08 08:13:14,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:13:14,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf80ae18d38d4eb0033bd HTTP/1.1" 200 None 2026-05-08 08:13:14,639 - lava_callback - DEBUG - Processing node 69faf80ae18d38d4eb0033bd: baseline-arm64-clabbe 2026-05-08 08:13:14,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf80ae18d38d4eb0033bd 2026-05-08 08:13:14,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:13:14,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf80ae18d38d4eb0033bd HTTP/1.1" 200 None 2026-05-08 08:13:14,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:13:14,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:13:14,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:13:14,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf80ae18d38d4eb0033bd HTTP/1.1" 200 None 2026-05-08 08:13:14,689 - lava_callback - ERROR - Error processing callback for node 69faf80ae18d38d4eb0033bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:14:34,688 - lava_callback - INFO - Received callback for node 69faf856e18d38d4eb0033e1 INFO: 172.20.0.1:57368 - "POST /node/69faf856e18d38d4eb0033e1 HTTP/1.0" 202 Accepted 2026-05-08 08:14:34,700 - lava_callback - INFO - Starting async job submit for node 69faf856e18d38d4eb0033e1 2026-05-08 08:14:34,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:14:34,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf856e18d38d4eb0033e1 HTTP/1.1" 200 None 2026-05-08 08:14:34,726 - lava_callback - DEBUG - Processing node 69faf856e18d38d4eb0033e1: baseline-arm64-clabbe 2026-05-08 08:14:34,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faf856e18d38d4eb0033e1 2026-05-08 08:14:34,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:14:34,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf856e18d38d4eb0033e1 HTTP/1.1" 200 None 2026-05-08 08:14:34,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:14:34,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-08 08:14:34,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:14:34,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faf856e18d38d4eb0033e1 HTTP/1.1" 200 None 2026-05-08 08:14:34,807 - lava_callback - ERROR - Error processing callback for node 69faf856e18d38d4eb0033e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]