INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:14:48,352 - lava_callback - INFO - Received callback for node 69fe0be4e98225c4a204a4ae 2026-05-10 16:14:48,358 - lava_callback - INFO - Starting async job submit for node 69fe0be4e98225c4a204a4ae INFO: 172.21.0.1:34594 - "POST /node/69fe0be4e98225c4a204a4ae HTTP/1.0" 202 Accepted 2026-05-10 16:14:48,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:14:48,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0be4e98225c4a204a4ae HTTP/1.1" 200 None 2026-05-10 16:14:48,397 - lava_callback - DEBUG - Processing node 69fe0be4e98225c4a204a4ae: baseline-arm64-clabbe 2026-05-10 16:14:48,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe0be4e98225c4a204a4ae 2026-05-10 16:14:48,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:14:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0be4e98225c4a204a4ae HTTP/1.1" 200 None 2026-05-10 16:14:48,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:14:48,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 16:14:48,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:14:48,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe0be4e98225c4a204a4ae HTTP/1.1" 200 None 2026-05-10 16:14:48,506 - lava_callback - ERROR - Error processing callback for node 69fe0be4e98225c4a204a4ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET /node/680df1c6ecaa1bdc2d752510%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:24:47,779 - lava_callback - INFO - Received callback for node 69fe0e4de4d4e78cd76add0d INFO: 172.21.0.1:47120 - "POST /node/69fe0e4de4d4e78cd76add0d HTTP/1.0" 202 Accepted 2026-05-10 16:24:47,784 - lava_callback - INFO - Starting async job submit for node 69fe0e4de4d4e78cd76add0d 2026-05-10 16:24:47,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:24:47,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0e4de4d4e78cd76add0d HTTP/1.1" 200 None 2026-05-10 16:24:47,799 - lava_callback - DEBUG - Processing node 69fe0e4de4d4e78cd76add0d: baseline-arm64-baylibre 2026-05-10 16:24:47,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe0e4de4d4e78cd76add0d 2026-05-10 16:24:47,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:24:47,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0e4de4d4e78cd76add0d HTTP/1.1" 200 None 2026-05-10 16:24:47,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:24:47,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:24:47,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:24:47,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe0e4de4d4e78cd76add0d HTTP/1.1" 200 None 2026-05-10 16:24:47,854 - lava_callback - ERROR - Error processing callback for node 69fe0e4de4d4e78cd76add0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:26:27,803 - lava_callback - INFO - Received callback for node 69fe0ea1e4d4e78cd76add53 INFO: 172.21.0.1:53630 - "POST /node/69fe0ea1e4d4e78cd76add53 HTTP/1.0" 202 Accepted 2026-05-10 16:26:27,809 - lava_callback - INFO - Starting async job submit for node 69fe0ea1e4d4e78cd76add53 2026-05-10 16:26:27,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:26:27,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0ea1e4d4e78cd76add53 HTTP/1.1" 200 None 2026-05-10 16:26:27,827 - lava_callback - DEBUG - Processing node 69fe0ea1e4d4e78cd76add53: baseline-arm64-baylibre 2026-05-10 16:26:27,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe0ea1e4d4e78cd76add53 2026-05-10 16:26:27,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:26:27,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0ea1e4d4e78cd76add53 HTTP/1.1" 200 None 2026-05-10 16:26:27,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:26:27,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:26:27,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:26:27,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe0ea1e4d4e78cd76add53 HTTP/1.1" 200 None 2026-05-10 16:26:27,899 - lava_callback - ERROR - Error processing callback for node 69fe0ea1e4d4e78cd76add53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:27:47,886 - lava_callback - INFO - Received callback for node 69fe0ef4e4d4e78cd76add8a INFO: 172.21.0.1:37888 - "POST /node/69fe0ef4e4d4e78cd76add8a HTTP/1.0" 202 Accepted 2026-05-10 16:27:47,892 - lava_callback - INFO - Starting async job submit for node 69fe0ef4e4d4e78cd76add8a 2026-05-10 16:27:47,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:27:47,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0ef4e4d4e78cd76add8a HTTP/1.1" 200 None 2026-05-10 16:27:47,914 - lava_callback - DEBUG - Processing node 69fe0ef4e4d4e78cd76add8a: baseline-arm64-baylibre 2026-05-10 16:27:47,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe0ef4e4d4e78cd76add8a 2026-05-10 16:27:47,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:27:47,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0ef4e4d4e78cd76add8a HTTP/1.1" 200 None 2026-05-10 16:27:47,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:27:47,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:27:47,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:27:47,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe0ef4e4d4e78cd76add8a HTTP/1.1" 200 None 2026-05-10 16:27:47,975 - lava_callback - ERROR - Error processing callback for node 69fe0ef4e4d4e78cd76add8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:29:07,895 - lava_callback - INFO - Received callback for node 69fe0f46e4d4e78cd76adde5 INFO: 172.21.0.1:48174 - "POST /node/69fe0f46e4d4e78cd76adde5 HTTP/1.0" 202 Accepted 2026-05-10 16:29:07,901 - lava_callback - INFO - Starting async job submit for node 69fe0f46e4d4e78cd76adde5 2026-05-10 16:29:07,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:29:07,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0f46e4d4e78cd76adde5 HTTP/1.1" 200 None 2026-05-10 16:29:07,917 - lava_callback - DEBUG - Processing node 69fe0f46e4d4e78cd76adde5: baseline-arm64-baylibre 2026-05-10 16:29:07,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe0f46e4d4e78cd76adde5 2026-05-10 16:29:07,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:29:07,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0f46e4d4e78cd76adde5 HTTP/1.1" 200 None 2026-05-10 16:29:07,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:29:07,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:29:07,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:29:07,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe0f46e4d4e78cd76adde5 HTTP/1.1" 200 None 2026-05-10 16:29:07,962 - lava_callback - ERROR - Error processing callback for node 69fe0f46e4d4e78cd76adde5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:30:28,058 - lava_callback - INFO - Received callback for node 69fe0f9be4d4e78cd76ade34 INFO: 172.21.0.1:43058 - "POST /node/69fe0f9be4d4e78cd76ade34 HTTP/1.0" 202 Accepted 2026-05-10 16:30:28,064 - lava_callback - INFO - Starting async job submit for node 69fe0f9be4d4e78cd76ade34 2026-05-10 16:30:28,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:30:28,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0f9be4d4e78cd76ade34 HTTP/1.1" 200 None 2026-05-10 16:30:28,087 - lava_callback - DEBUG - Processing node 69fe0f9be4d4e78cd76ade34: baseline-arm64-baylibre 2026-05-10 16:30:28,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe0f9be4d4e78cd76ade34 2026-05-10 16:30:28,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:30:28,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0f9be4d4e78cd76ade34 HTTP/1.1" 200 None 2026-05-10 16:30:28,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:30:28,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:30:28,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:30:28,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe0f9be4d4e78cd76ade34 HTTP/1.1" 200 None 2026-05-10 16:30:28,133 - lava_callback - ERROR - Error processing callback for node 69fe0f9be4d4e78cd76ade34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:31:48,075 - lava_callback - INFO - Received callback for node 69fe0fefe4d4e78cd76ade7c INFO: 172.21.0.1:53580 - "POST /node/69fe0fefe4d4e78cd76ade7c HTTP/1.0" 202 Accepted 2026-05-10 16:31:48,081 - lava_callback - INFO - Starting async job submit for node 69fe0fefe4d4e78cd76ade7c 2026-05-10 16:31:48,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:31:48,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0fefe4d4e78cd76ade7c HTTP/1.1" 200 None 2026-05-10 16:31:48,096 - lava_callback - DEBUG - Processing node 69fe0fefe4d4e78cd76ade7c: baseline-arm64-baylibre 2026-05-10 16:31:48,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe0fefe4d4e78cd76ade7c 2026-05-10 16:31:48,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:31:48,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0fefe4d4e78cd76ade7c HTTP/1.1" 200 None 2026-05-10 16:31:48,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:31:48,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:31:48,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:31:48,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe0fefe4d4e78cd76ade7c HTTP/1.1" 200 None 2026-05-10 16:31:48,141 - lava_callback - ERROR - Error processing callback for node 69fe0fefe4d4e78cd76ade7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:32:11,434 - lava_callback - INFO - Received callback for node 6a00b28d379c7180ed7860f8 INFO: 172.21.0.1:47740 - "POST /node/6a00b28d379c7180ed7860f8 HTTP/1.0" 202 Accepted 2026-05-10 16:32:11,440 - lava_callback - INFO - Starting async job submit for node 6a00b28d379c7180ed7860f8 2026-05-10 16:32:11,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:32:11,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b28d379c7180ed7860f8 HTTP/1.1" 200 None 2026-05-10 16:32:11,477 - lava_callback - DEBUG - Processing node 6a00b28d379c7180ed7860f8: baseline-arm 2026-05-10 16:32:11,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:32:11,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:32:11,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b28d379c7180ed7860f8/log.txt.gz 2026-05-10 16:32:12,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:32:12,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:32:12,211 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b28d379c7180ed7860f8/lava-logs.yaml 2026-05-10 16:32:12,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:32:12,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:32:12,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b28d379c7180ed7860f8/lava_callback.json.gz 2026-05-10 16:32:12,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:32:12,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b28d379c7180ed7860f8 HTTP/1.1" 200 None 2026-05-10 16:32:12,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:32:12,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af89379c7180ed783980 HTTP/1.1" 200 None 2026-05-10 16:32:12,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:32:12,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b28d379c7180ed7860f8 HTTP/1.1" 200 None 2026-05-10 16:32:12,397 - lava_callback - INFO - Completed processing callback for node 6a00b28d379c7180ed7860f8 INFO: 172.21.0.1:47750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47752 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:32:18,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:32:18,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:33:28,182 - lava_callback - INFO - Received callback for node 69fe1045e4d4e78cd76adeb0 INFO: 172.21.0.1:51906 - "POST /node/69fe1045e4d4e78cd76adeb0 HTTP/1.0" 202 Accepted 2026-05-10 16:33:28,191 - lava_callback - INFO - Starting async job submit for node 69fe1045e4d4e78cd76adeb0 2026-05-10 16:33:28,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:33:28,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1045e4d4e78cd76adeb0 HTTP/1.1" 200 None 2026-05-10 16:33:28,208 - lava_callback - DEBUG - Processing node 69fe1045e4d4e78cd76adeb0: baseline-arm64-baylibre 2026-05-10 16:33:28,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1045e4d4e78cd76adeb0 2026-05-10 16:33:28,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:33:28,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1045e4d4e78cd76adeb0 HTTP/1.1" 200 None 2026-05-10 16:33:28,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:33:28,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:33:28,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:33:28,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1045e4d4e78cd76adeb0 HTTP/1.1" 200 None 2026-05-10 16:33:28,264 - lava_callback - ERROR - Error processing callback for node 69fe1045e4d4e78cd76adeb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET /node/6800c135dc6beac7fcd80615%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:34:48,377 - lava_callback - INFO - Received callback for node 69fe1097e4d4e78cd76aded8 INFO: 172.21.0.1:58268 - "POST /node/69fe1097e4d4e78cd76aded8 HTTP/1.0" 202 Accepted 2026-05-10 16:34:48,383 - lava_callback - INFO - Starting async job submit for node 69fe1097e4d4e78cd76aded8 2026-05-10 16:34:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:34:48,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1097e4d4e78cd76aded8 HTTP/1.1" 200 None 2026-05-10 16:34:48,403 - lava_callback - DEBUG - Processing node 69fe1097e4d4e78cd76aded8: baseline-arm64-baylibre 2026-05-10 16:34:48,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1097e4d4e78cd76aded8 2026-05-10 16:34:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:34:48,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1097e4d4e78cd76aded8 HTTP/1.1" 200 None 2026-05-10 16:34:48,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:34:48,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:34:48,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:34:48,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1097e4d4e78cd76aded8 HTTP/1.1" 200 None 2026-05-10 16:34:48,449 - lava_callback - ERROR - Error processing callback for node 69fe1097e4d4e78cd76aded8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:36:08,298 - lava_callback - INFO - Received callback for node 69fe10ede4d4e78cd76adf17 INFO: 172.21.0.1:43466 - "POST /node/69fe10ede4d4e78cd76adf17 HTTP/1.0" 202 Accepted 2026-05-10 16:36:08,308 - lava_callback - INFO - Starting async job submit for node 69fe10ede4d4e78cd76adf17 2026-05-10 16:36:08,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:36:08,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe10ede4d4e78cd76adf17 HTTP/1.1" 200 None 2026-05-10 16:36:08,323 - lava_callback - DEBUG - Processing node 69fe10ede4d4e78cd76adf17: baseline-arm64-baylibre 2026-05-10 16:36:08,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe10ede4d4e78cd76adf17 2026-05-10 16:36:08,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:36:08,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe10ede4d4e78cd76adf17 HTTP/1.1" 200 None 2026-05-10 16:36:08,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:36:08,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:36:08,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:36:08,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe10ede4d4e78cd76adf17 HTTP/1.1" 200 None 2026-05-10 16:36:08,377 - lava_callback - ERROR - Error processing callback for node 69fe10ede4d4e78cd76adf17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:37:08,279 - lava_callback - INFO - Received callback for node 69fe111fe4d4e78cd76adf56 INFO: 172.21.0.1:50298 - "POST /node/69fe111fe4d4e78cd76adf56 HTTP/1.0" 202 Accepted 2026-05-10 16:37:08,302 - lava_callback - INFO - Starting async job submit for node 69fe111fe4d4e78cd76adf56 2026-05-10 16:37:08,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:08,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111fe4d4e78cd76adf56 HTTP/1.1" 200 None 2026-05-10 16:37:08,347 - lava_callback - DEBUG - Processing node 69fe111fe4d4e78cd76adf56: baseline-arm-baylibre 2026-05-10 16:37:08,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe111fe4d4e78cd76adf56 2026-05-10 16:37:08,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:08,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe111fe4d4e78cd76adf56 HTTP/1.1" 200 None 2026-05-10 16:37:08,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:08,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:08,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:08,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe111fe4d4e78cd76adf56 HTTP/1.1" 200 None 2026-05-10 16:37:08,444 - lava_callback - ERROR - Error processing callback for node 69fe111fe4d4e78cd76adf56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:09,093 - lava_callback - INFO - Received callback for node 69fe1121e4d4e78cd76adf59 INFO: 172.21.0.1:50312 - "POST /node/69fe1121e4d4e78cd76adf59 HTTP/1.0" 202 Accepted 2026-05-10 16:37:09,104 - lava_callback - INFO - Starting async job submit for node 69fe1121e4d4e78cd76adf59 2026-05-10 16:37:09,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1121e4d4e78cd76adf59 HTTP/1.1" 200 None 2026-05-10 16:37:09,132 - lava_callback - DEBUG - Processing node 69fe1121e4d4e78cd76adf59: baseline-arm-baylibre 2026-05-10 16:37:09,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1121e4d4e78cd76adf59 2026-05-10 16:37:09,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1121e4d4e78cd76adf59 HTTP/1.1" 200 None 2026-05-10 16:37:09,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:09,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1121e4d4e78cd76adf59 HTTP/1.1" 200 None 2026-05-10 16:37:09,243 - lava_callback - ERROR - Error processing callback for node 69fe1121e4d4e78cd76adf59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:09,493 - lava_callback - INFO - Received callback for node 69fe112ee4d4e78cd76adf7f INFO: 172.21.0.1:50316 - "POST /node/69fe112ee4d4e78cd76adf7f HTTP/1.0" 202 Accepted 2026-05-10 16:37:09,507 - lava_callback - INFO - Starting async job submit for node 69fe112ee4d4e78cd76adf7f 2026-05-10 16:37:09,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe112ee4d4e78cd76adf7f HTTP/1.1" 200 None 2026-05-10 16:37:09,558 - lava_callback - DEBUG - Processing node 69fe112ee4d4e78cd76adf7f: baseline-arm-clabbe 2026-05-10 16:37:09,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe112ee4d4e78cd76adf7f 2026-05-10 16:37:09,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe112ee4d4e78cd76adf7f HTTP/1.1" 200 None 2026-05-10 16:37:09,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:09,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe112ee4d4e78cd76adf7f HTTP/1.1" 200 None 2026-05-10 16:37:09,672 - lava_callback - ERROR - Error processing callback for node 69fe112ee4d4e78cd76adf7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:09,783 - lava_callback - INFO - Received callback for node 69fe1122e4d4e78cd76adf5c INFO: 172.21.0.1:52962 - "POST /node/69fe1122e4d4e78cd76adf5c HTTP/1.0" 202 Accepted 2026-05-10 16:37:09,794 - lava_callback - INFO - Starting async job submit for node 69fe1122e4d4e78cd76adf5c 2026-05-10 16:37:09,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1122e4d4e78cd76adf5c HTTP/1.1" 200 None 2026-05-10 16:37:09,843 - lava_callback - DEBUG - Processing node 69fe1122e4d4e78cd76adf5c: baseline-arm-baylibre 2026-05-10 16:37:09,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1122e4d4e78cd76adf5c 2026-05-10 16:37:09,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1122e4d4e78cd76adf5c HTTP/1.1" 200 None 2026-05-10 16:37:09,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:09,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:09,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1122e4d4e78cd76adf5c HTTP/1.1" 200 None 2026-05-10 16:37:09,989 - lava_callback - ERROR - Error processing callback for node 69fe1122e4d4e78cd76adf5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:10,210 - lava_callback - INFO - Received callback for node 69fe1132e4d4e78cd76adf8c INFO: 172.21.0.1:52976 - "POST /node/69fe1132e4d4e78cd76adf8c HTTP/1.0" 202 Accepted 2026-05-10 16:37:10,222 - lava_callback - INFO - Starting async job submit for node 69fe1132e4d4e78cd76adf8c 2026-05-10 16:37:10,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1132e4d4e78cd76adf8c HTTP/1.1" 200 None 2026-05-10 16:37:10,278 - lava_callback - DEBUG - Processing node 69fe1132e4d4e78cd76adf8c: baseline-arm-clabbe 2026-05-10 16:37:10,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1132e4d4e78cd76adf8c 2026-05-10 16:37:10,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1132e4d4e78cd76adf8c HTTP/1.1" 200 None 2026-05-10 16:37:10,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:10,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1132e4d4e78cd76adf8c HTTP/1.1" 200 None 2026-05-10 16:37:10,413 - lava_callback - ERROR - Error processing callback for node 69fe1132e4d4e78cd76adf8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:10,451 - lava_callback - INFO - Received callback for node 69fe1123e4d4e78cd76adf5f INFO: 172.21.0.1:52988 - "POST /node/69fe1123e4d4e78cd76adf5f HTTP/1.0" 202 Accepted 2026-05-10 16:37:10,466 - lava_callback - INFO - Starting async job submit for node 69fe1123e4d4e78cd76adf5f 2026-05-10 16:37:10,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1123e4d4e78cd76adf5f HTTP/1.1" 200 None 2026-05-10 16:37:10,494 - lava_callback - DEBUG - Processing node 69fe1123e4d4e78cd76adf5f: baseline-arm-baylibre 2026-05-10 16:37:10,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1123e4d4e78cd76adf5f 2026-05-10 16:37:10,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1123e4d4e78cd76adf5f HTTP/1.1" 200 None 2026-05-10 16:37:10,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:10,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1123e4d4e78cd76adf5f HTTP/1.1" 200 None 2026-05-10 16:37:10,653 - lava_callback - ERROR - Error processing callback for node 69fe1123e4d4e78cd76adf5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:10,887 - lava_callback - INFO - Received callback for node 69fe1133e4d4e78cd76adf8f INFO: 172.21.0.1:52994 - "POST /node/69fe1133e4d4e78cd76adf8f HTTP/1.0" 202 Accepted 2026-05-10 16:37:10,898 - lava_callback - INFO - Starting async job submit for node 69fe1133e4d4e78cd76adf8f 2026-05-10 16:37:10,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1133e4d4e78cd76adf8f HTTP/1.1" 200 None 2026-05-10 16:37:10,931 - lava_callback - DEBUG - Processing node 69fe1133e4d4e78cd76adf8f: baseline-arm-clabbe 2026-05-10 16:37:10,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1133e4d4e78cd76adf8f 2026-05-10 16:37:10,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1133e4d4e78cd76adf8f HTTP/1.1" 200 None 2026-05-10 16:37:10,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:10,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:10,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1133e4d4e78cd76adf8f HTTP/1.1" 200 None 2026-05-10 16:37:11,036 - lava_callback - ERROR - Error processing callback for node 69fe1133e4d4e78cd76adf8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:11,105 - lava_callback - INFO - Received callback for node 69fe1126e4d4e78cd76adf6a INFO: 172.21.0.1:53004 - "POST /node/69fe1126e4d4e78cd76adf6a HTTP/1.0" 202 Accepted 2026-05-10 16:37:11,119 - lava_callback - INFO - Starting async job submit for node 69fe1126e4d4e78cd76adf6a 2026-05-10 16:37:11,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1126e4d4e78cd76adf6a HTTP/1.1" 200 None 2026-05-10 16:37:11,201 - lava_callback - DEBUG - Processing node 69fe1126e4d4e78cd76adf6a: baseline-arm-baylibre 2026-05-10 16:37:11,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1126e4d4e78cd76adf6a 2026-05-10 16:37:11,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1126e4d4e78cd76adf6a HTTP/1.1" 200 None 2026-05-10 16:37:11,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:11,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1126e4d4e78cd76adf6a HTTP/1.1" 200 None 2026-05-10 16:37:11,377 - lava_callback - ERROR - Error processing callback for node 69fe1126e4d4e78cd76adf6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:11,787 - lava_callback - INFO - Received callback for node 69fe1127e4d4e78cd76adf6f INFO: 172.21.0.1:53006 - "POST /node/69fe1127e4d4e78cd76adf6f HTTP/1.0" 202 Accepted 2026-05-10 16:37:11,801 - lava_callback - INFO - Starting async job submit for node 69fe1127e4d4e78cd76adf6f 2026-05-10 16:37:11,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1127e4d4e78cd76adf6f HTTP/1.1" 200 None 2026-05-10 16:37:11,829 - lava_callback - DEBUG - Processing node 69fe1127e4d4e78cd76adf6f: baseline-arm-baylibre 2026-05-10 16:37:11,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1127e4d4e78cd76adf6f 2026-05-10 16:37:11,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1127e4d4e78cd76adf6f HTTP/1.1" 200 None 2026-05-10 16:37:11,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:11,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:11,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1127e4d4e78cd76adf6f HTTP/1.1" 200 None 2026-05-10 16:37:11,958 - lava_callback - ERROR - Error processing callback for node 69fe1127e4d4e78cd76adf6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:37:28,309 - lava_callback - INFO - Received callback for node 69fe1142e4d4e78cd76adfe8 INFO: 172.21.0.1:41762 - "POST /node/69fe1142e4d4e78cd76adfe8 HTTP/1.0" 202 Accepted 2026-05-10 16:37:28,315 - lava_callback - INFO - Starting async job submit for node 69fe1142e4d4e78cd76adfe8 2026-05-10 16:37:28,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:28,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1142e4d4e78cd76adfe8 HTTP/1.1" 200 None 2026-05-10 16:37:28,333 - lava_callback - DEBUG - Processing node 69fe1142e4d4e78cd76adfe8: baseline-arm64-baylibre 2026-05-10 16:37:28,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1142e4d4e78cd76adfe8 2026-05-10 16:37:28,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:28,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1142e4d4e78cd76adfe8 HTTP/1.1" 200 None 2026-05-10 16:37:28,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:28,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:37:28,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:28,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1142e4d4e78cd76adfe8 HTTP/1.1" 200 None 2026-05-10 16:37:28,393 - lava_callback - ERROR - Error processing callback for node 69fe1142e4d4e78cd76adfe8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:29,190 - lava_callback - INFO - Received callback for node 69fe1134e4d4e78cd76adf92 INFO: 172.21.0.1:41768 - "POST /node/69fe1134e4d4e78cd76adf92 HTTP/1.0" 202 Accepted 2026-05-10 16:37:29,198 - lava_callback - INFO - Starting async job submit for node 69fe1134e4d4e78cd76adf92 2026-05-10 16:37:29,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:29,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1134e4d4e78cd76adf92 HTTP/1.1" 200 None 2026-05-10 16:37:29,216 - lava_callback - DEBUG - Processing node 69fe1134e4d4e78cd76adf92: baseline-arm-clabbe 2026-05-10 16:37:29,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1134e4d4e78cd76adf92 2026-05-10 16:37:29,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:29,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1134e4d4e78cd76adf92 HTTP/1.1" 200 None 2026-05-10 16:37:29,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:29,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:29,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:29,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1134e4d4e78cd76adf92 HTTP/1.1" 200 None 2026-05-10 16:37:29,289 - lava_callback - ERROR - Error processing callback for node 69fe1134e4d4e78cd76adf92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:29,870 - lava_callback - INFO - Received callback for node 69fe1135e4d4e78cd76adfbf INFO: 172.21.0.1:42244 - "POST /node/69fe1135e4d4e78cd76adfbf HTTP/1.0" 202 Accepted 2026-05-10 16:37:29,875 - lava_callback - INFO - Starting async job submit for node 69fe1135e4d4e78cd76adfbf 2026-05-10 16:37:29,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:29,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1135e4d4e78cd76adfbf HTTP/1.1" 200 None 2026-05-10 16:37:29,898 - lava_callback - DEBUG - Processing node 69fe1135e4d4e78cd76adfbf: baseline-arm-clabbe 2026-05-10 16:37:29,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1135e4d4e78cd76adfbf 2026-05-10 16:37:29,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:29,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1135e4d4e78cd76adfbf HTTP/1.1" 200 None 2026-05-10 16:37:29,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:29,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:29,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:29,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1135e4d4e78cd76adfbf HTTP/1.1" 200 None 2026-05-10 16:37:29,980 - lava_callback - ERROR - Error processing callback for node 69fe1135e4d4e78cd76adfbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:37:30,543 - lava_callback - INFO - Received callback for node 69fe1137e4d4e78cd76adfc7 INFO: 172.21.0.1:42246 - "POST /node/69fe1137e4d4e78cd76adfc7 HTTP/1.0" 202 Accepted 2026-05-10 16:37:30,549 - lava_callback - INFO - Starting async job submit for node 69fe1137e4d4e78cd76adfc7 2026-05-10 16:37:30,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:30,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1137e4d4e78cd76adfc7 HTTP/1.1" 200 None 2026-05-10 16:37:30,564 - lava_callback - DEBUG - Processing node 69fe1137e4d4e78cd76adfc7: baseline-arm-clabbe 2026-05-10 16:37:30,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1137e4d4e78cd76adfc7 2026-05-10 16:37:30,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:30,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1137e4d4e78cd76adfc7 HTTP/1.1" 200 None 2026-05-10 16:37:30,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:30,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 16:37:30,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:30,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1137e4d4e78cd76adfc7 HTTP/1.1" 200 None 2026-05-10 16:37:30,611 - lava_callback - ERROR - Error processing callback for node 69fe1137e4d4e78cd76adfc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:37:37,873 - lava_callback - INFO - Received callback for node 6a00b42e379c7180ed786120 INFO: 172.21.0.1:42270 - "POST /node/6a00b42e379c7180ed786120 HTTP/1.0" 202 Accepted 2026-05-10 16:37:37,883 - lava_callback - INFO - Starting async job submit for node 6a00b42e379c7180ed786120 2026-05-10 16:37:37,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:37,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b42e379c7180ed786120 HTTP/1.1" 200 None 2026-05-10 16:37:37,918 - lava_callback - DEBUG - Processing node 6a00b42e379c7180ed786120: baseline-x86 2026-05-10 16:37:38,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:37:38,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:37:38,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b42e379c7180ed786120/log.txt.gz 2026-05-10 16:37:38,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:37:38,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:37:38,776 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b42e379c7180ed786120/lava-logs.yaml 2026-05-10 16:37:38,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:37:38,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:37:38,879 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b42e379c7180ed786120/lava_callback.json.gz 2026-05-10 16:37:38,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:38,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b42e379c7180ed786120 HTTP/1.1" 200 None 2026-05-10 16:37:38,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:38,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00afa3379c7180ed7839a7 HTTP/1.1" 200 None 2026-05-10 16:37:38,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:38,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b42e379c7180ed786120 HTTP/1.1" 200 None 2026-05-10 16:37:38,948 - lava_callback - INFO - Completed processing callback for node 6a00b42e379c7180ed786120 INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:37:48,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:48,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 16:37:50,307 - lava_callback - INFO - Received callback for node 6a00b431379c7180ed786129 INFO: 172.21.0.1:52422 - "POST /node/6a00b431379c7180ed786129 HTTP/1.0" 202 Accepted 2026-05-10 16:37:50,317 - lava_callback - INFO - Starting async job submit for node 6a00b431379c7180ed786129 2026-05-10 16:37:50,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:50,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b431379c7180ed786129 HTTP/1.1" 200 None 2026-05-10 16:37:50,361 - lava_callback - DEBUG - Processing node 6a00b431379c7180ed786129: baseline-x86 2026-05-10 16:37:50,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:37:50,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:37:50,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b431379c7180ed786129/log.txt.gz 2026-05-10 16:37:50,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:37:50,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:37:50,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b431379c7180ed786129/lava-logs.yaml 2026-05-10 16:37:50,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:37:51,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:37:51,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b431379c7180ed786129/lava_callback.json.gz 2026-05-10 16:37:51,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:51,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b431379c7180ed786129 HTTP/1.1" 200 None 2026-05-10 16:37:51,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:51,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00afa3379c7180ed7839a7 HTTP/1.1" 200 None 2026-05-10 16:37:51,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:37:51,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b431379c7180ed786129 HTTP/1.1" 200 None 2026-05-10 16:37:51,149 - lava_callback - INFO - Completed processing callback for node 6a00b431379c7180ed786129 INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:38:18,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:18,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:38:41,144 - lava_callback - INFO - Received callback for node 6a00b430379c7180ed786126 INFO: 172.21.0.1:41346 - "POST /node/6a00b430379c7180ed786126 HTTP/1.0" 202 Accepted 2026-05-10 16:38:41,151 - lava_callback - INFO - Starting async job submit for node 6a00b430379c7180ed786126 2026-05-10 16:38:41,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:41,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b430379c7180ed786126 HTTP/1.1" 200 None 2026-05-10 16:38:41,184 - lava_callback - DEBUG - Processing node 6a00b430379c7180ed786126: baseline-x86 2026-05-10 16:38:41,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:38:41,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:38:41,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b430379c7180ed786126/log.txt.gz 2026-05-10 16:38:41,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:38:41,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:38:41,916 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b430379c7180ed786126/lava-logs.yaml 2026-05-10 16:38:41,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:38:42,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:38:42,073 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b430379c7180ed786126/lava_callback.json.gz 2026-05-10 16:38:42,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:42,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b430379c7180ed786126 HTTP/1.1" 200 None 2026-05-10 16:38:42,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:42,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00afa3379c7180ed7839a7 HTTP/1.1" 200 None 2026-05-10 16:38:42,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:42,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b430379c7180ed786126 HTTP/1.1" 200 None 2026-05-10 16:38:42,153 - lava_callback - INFO - Completed processing callback for node 6a00b430379c7180ed786126 INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:38:47,796 - lava_callback - INFO - Received callback for node 6a00b42f379c7180ed786123 INFO: 172.21.0.1:41368 - "POST /node/6a00b42f379c7180ed786123 HTTP/1.0" 202 Accepted 2026-05-10 16:38:47,804 - lava_callback - INFO - Starting async job submit for node 6a00b42f379c7180ed786123 2026-05-10 16:38:47,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:47,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b42f379c7180ed786123 HTTP/1.1" 200 None 2026-05-10 16:38:47,840 - lava_callback - DEBUG - Processing node 6a00b42f379c7180ed786123: baseline-x86 2026-05-10 16:38:48,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:38:48,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:38:48,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b42f379c7180ed786123/log.txt.gz 2026-05-10 16:38:48,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:38:48,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:48,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 16:38:48,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:38:48,639 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b42f379c7180ed786123/lava-logs.yaml 2026-05-10 16:38:48,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:38:48,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:38:48,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a00b42f379c7180ed786123/lava_callback.json.gz 2026-05-10 16:38:48,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:48,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b42f379c7180ed786123 HTTP/1.1" 200 None 2026-05-10 16:38:48,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:48,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00afa3379c7180ed7839a7 HTTP/1.1" 200 None 2026-05-10 16:38:48,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:38:48,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b42f379c7180ed786123 HTTP/1.1" 200 None 2026-05-10 16:38:48,851 - lava_callback - INFO - Completed processing callback for node 6a00b42f379c7180ed786123 INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:39:08,424 - lava_callback - INFO - Received callback for node 69fe1199e4d4e78cd76ae0b6 INFO: 172.21.0.1:43352 - "POST /node/69fe1199e4d4e78cd76ae0b6 HTTP/1.0" 202 Accepted 2026-05-10 16:39:08,430 - lava_callback - INFO - Starting async job submit for node 69fe1199e4d4e78cd76ae0b6 2026-05-10 16:39:08,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:08,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1199e4d4e78cd76ae0b6 HTTP/1.1" 200 None 2026-05-10 16:39:08,451 - lava_callback - DEBUG - Processing node 69fe1199e4d4e78cd76ae0b6: baseline-arm64-baylibre 2026-05-10 16:39:08,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1199e4d4e78cd76ae0b6 2026-05-10 16:39:08,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:08,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1199e4d4e78cd76ae0b6 HTTP/1.1" 200 None 2026-05-10 16:39:08,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:08,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:39:08,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:08,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1199e4d4e78cd76ae0b6 HTTP/1.1" 200 None 2026-05-10 16:39:08,512 - lava_callback - ERROR - Error processing callback for node 69fe1199e4d4e78cd76ae0b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:39:18,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:18,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 16:39:21,939 - lava_callback - INFO - Received callback for node 69fe11ace4d4e78cd76ae0f5 INFO: 172.21.0.1:36016 - "POST /node/69fe11ace4d4e78cd76ae0f5 HTTP/1.0" 202 Accepted 2026-05-10 16:39:21,945 - lava_callback - INFO - Starting async job submit for node 69fe11ace4d4e78cd76ae0f5 2026-05-10 16:39:21,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:21,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11ace4d4e78cd76ae0f5 HTTP/1.1" 200 None 2026-05-10 16:39:21,966 - lava_callback - DEBUG - Processing node 69fe11ace4d4e78cd76ae0f5: baseline-x86 2026-05-10 16:39:21,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe11ace4d4e78cd76ae0f5 2026-05-10 16:39:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:21,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11ace4d4e78cd76ae0f5 HTTP/1.1" 200 None 2026-05-10 16:39:21,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:22,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d56e4d4e78cd76adcf2 HTTP/1.1" 200 None 2026-05-10 16:39:22,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:39:22,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe11ace4d4e78cd76ae0f5 HTTP/1.1" 200 None 2026-05-10 16:39:22,043 - lava_callback - ERROR - Error processing callback for node 69fe11ace4d4e78cd76ae0f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:40:28,495 - lava_callback - INFO - Received callback for node 69fe11efe4d4e78cd76ae148 INFO: 172.21.0.1:57376 - "POST /node/69fe11efe4d4e78cd76ae148 HTTP/1.0" 202 Accepted 2026-05-10 16:40:28,501 - lava_callback - INFO - Starting async job submit for node 69fe11efe4d4e78cd76ae148 2026-05-10 16:40:28,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:40:28,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11efe4d4e78cd76ae148 HTTP/1.1" 200 None 2026-05-10 16:40:28,517 - lava_callback - DEBUG - Processing node 69fe11efe4d4e78cd76ae148: baseline-arm64-baylibre 2026-05-10 16:40:28,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe11efe4d4e78cd76ae148 2026-05-10 16:40:28,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:40:28,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe11efe4d4e78cd76ae148 HTTP/1.1" 200 None 2026-05-10 16:40:28,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:40:28,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:40:28,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:40:28,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe11efe4d4e78cd76ae148 HTTP/1.1" 200 None 2026-05-10 16:40:28,582 - lava_callback - ERROR - Error processing callback for node 69fe11efe4d4e78cd76ae148: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:41:48,603 - lava_callback - INFO - Received callback for node 69fe1240e4d4e78cd76ae180 INFO: 172.21.0.1:54670 - "POST /node/69fe1240e4d4e78cd76ae180 HTTP/1.0" 202 Accepted 2026-05-10 16:41:48,612 - lava_callback - INFO - Starting async job submit for node 69fe1240e4d4e78cd76ae180 2026-05-10 16:41:48,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:41:48,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1240e4d4e78cd76ae180 HTTP/1.1" 200 None 2026-05-10 16:41:48,628 - lava_callback - DEBUG - Processing node 69fe1240e4d4e78cd76ae180: baseline-arm64-baylibre 2026-05-10 16:41:48,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1240e4d4e78cd76ae180 2026-05-10 16:41:48,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:41:48,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1240e4d4e78cd76ae180 HTTP/1.1" 200 None 2026-05-10 16:41:48,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:41:48,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:41:48,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:41:48,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1240e4d4e78cd76ae180 HTTP/1.1" 200 None 2026-05-10 16:41:48,683 - lava_callback - ERROR - Error processing callback for node 69fe1240e4d4e78cd76ae180: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET /node/68078096ddef6a18a51fbdd2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:43:08,627 - lava_callback - INFO - Received callback for node 69fe128fe4d4e78cd76ae1dd INFO: 172.21.0.1:45504 - "POST /node/69fe128fe4d4e78cd76ae1dd HTTP/1.0" 202 Accepted 2026-05-10 16:43:08,632 - lava_callback - INFO - Starting async job submit for node 69fe128fe4d4e78cd76ae1dd 2026-05-10 16:43:08,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:43:08,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe128fe4d4e78cd76ae1dd HTTP/1.1" 200 None 2026-05-10 16:43:08,649 - lava_callback - DEBUG - Processing node 69fe128fe4d4e78cd76ae1dd: baseline-arm64-baylibre 2026-05-10 16:43:08,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe128fe4d4e78cd76ae1dd 2026-05-10 16:43:08,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:43:08,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe128fe4d4e78cd76ae1dd HTTP/1.1" 200 None 2026-05-10 16:43:08,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:43:08,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:43:08,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:43:08,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe128fe4d4e78cd76ae1dd HTTP/1.1" 200 None 2026-05-10 16:43:08,702 - lava_callback - ERROR - Error processing callback for node 69fe128fe4d4e78cd76ae1dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:44:28,696 - lava_callback - INFO - Received callback for node 69fe12e1e4d4e78cd76ae21f INFO: 172.21.0.1:50542 - "POST /node/69fe12e1e4d4e78cd76ae21f HTTP/1.0" 202 Accepted 2026-05-10 16:44:28,705 - lava_callback - INFO - Starting async job submit for node 69fe12e1e4d4e78cd76ae21f 2026-05-10 16:44:28,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:44:28,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe12e1e4d4e78cd76ae21f HTTP/1.1" 200 None 2026-05-10 16:44:28,728 - lava_callback - DEBUG - Processing node 69fe12e1e4d4e78cd76ae21f: baseline-arm64-baylibre 2026-05-10 16:44:28,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe12e1e4d4e78cd76ae21f 2026-05-10 16:44:28,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:44:28,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe12e1e4d4e78cd76ae21f HTTP/1.1" 200 None 2026-05-10 16:44:28,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:44:28,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:44:28,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:44:28,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe12e1e4d4e78cd76ae21f HTTP/1.1" 200 None 2026-05-10 16:44:28,795 - lava_callback - ERROR - Error processing callback for node 69fe12e1e4d4e78cd76ae21f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:45:45,285 - lava_callback - INFO - Received callback for node 6a00b62a379c7180ed786218 INFO: 172.21.0.1:38936 - "POST /node/6a00b62a379c7180ed786218 HTTP/1.0" 202 Accepted 2026-05-10 16:45:45,292 - lava_callback - INFO - Starting async job submit for node 6a00b62a379c7180ed786218 2026-05-10 16:45:45,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:45,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62a379c7180ed786218 HTTP/1.1" 200 None 2026-05-10 16:45:45,311 - lava_callback - DEBUG - Processing node 6a00b62a379c7180ed786218: baseline-arm 2026-05-10 16:45:45,320 - lava_callback - WARNING - Failed to upload log 2026-05-10 16:45:45,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:45:45,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:45:45,419 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62a379c7180ed786218/lava-logs.yaml 2026-05-10 16:45:45,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:45:45,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:45:45,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62a379c7180ed786218/lava_callback.json.gz 2026-05-10 16:45:45,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:45,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62a379c7180ed786218 HTTP/1.1" 200 None 2026-05-10 16:45:45,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:45,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:45:45,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:45,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b62a379c7180ed786218 HTTP/1.1" 200 None 2026-05-10 16:45:45,601 - lava_callback - INFO - Completed processing callback for node 6a00b62a379c7180ed786218 INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:45:48,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:48,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 16:45:48,760 - lava_callback - INFO - Received callback for node 69fe1334e4d4e78cd76ae26d INFO: 172.21.0.1:38950 - "POST /node/69fe1334e4d4e78cd76ae26d HTTP/1.0" 202 Accepted 2026-05-10 16:45:48,770 - lava_callback - INFO - Starting async job submit for node 69fe1334e4d4e78cd76ae26d 2026-05-10 16:45:48,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:48,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1334e4d4e78cd76ae26d HTTP/1.1" 200 None 2026-05-10 16:45:48,798 - lava_callback - DEBUG - Processing node 69fe1334e4d4e78cd76ae26d: baseline-arm64-baylibre 2026-05-10 16:45:48,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1334e4d4e78cd76ae26d 2026-05-10 16:45:48,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:48,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1334e4d4e78cd76ae26d HTTP/1.1" 200 None 2026-05-10 16:45:48,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:48,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:45:48,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:45:48,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1334e4d4e78cd76ae26d HTTP/1.1" 200 None 2026-05-10 16:45:48,846 - lava_callback - ERROR - Error processing callback for node 69fe1334e4d4e78cd76ae26d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:46:01,847 - lava_callback - INFO - Received callback for node 6a00b62b379c7180ed78621b INFO: 172.21.0.1:38244 - "POST /node/6a00b62b379c7180ed78621b HTTP/1.0" 202 Accepted 2026-05-10 16:46:01,898 - lava_callback - INFO - Starting async job submit for node 6a00b62b379c7180ed78621b 2026-05-10 16:46:01,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:02,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62b379c7180ed78621b HTTP/1.1" 200 None 2026-05-10 16:46:02,003 - lava_callback - DEBUG - Processing node 6a00b62b379c7180ed78621b: baseline-arm 2026-05-10 16:46:02,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:02,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:02,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62b379c7180ed78621b/log.txt.gz 2026-05-10 16:46:02,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:02,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:02,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62b379c7180ed78621b/lava-logs.yaml 2026-05-10 16:46:02,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:02,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:02,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62b379c7180ed78621b/lava_callback.json.gz 2026-05-10 16:46:02,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:02,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62b379c7180ed78621b HTTP/1.1" 200 None 2026-05-10 16:46:02,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:02,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:46:02,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:02,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b62b379c7180ed78621b HTTP/1.1" 200 None 2026-05-10 16:46:02,625 - lava_callback - INFO - Completed processing callback for node 6a00b62b379c7180ed78621b INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:46:08,715 - lava_callback - INFO - Received callback for node 6a00b62e379c7180ed786224 INFO: 172.21.0.1:38272 - "POST /node/6a00b62e379c7180ed786224 HTTP/1.0" 202 Accepted 2026-05-10 16:46:08,766 - lava_callback - INFO - Starting async job submit for node 6a00b62e379c7180ed786224 2026-05-10 16:46:08,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:08,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62e379c7180ed786224 HTTP/1.1" 200 None 2026-05-10 16:46:08,809 - lava_callback - DEBUG - Processing node 6a00b62e379c7180ed786224: baseline-arm 2026-05-10 16:46:08,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:09,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:09,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62e379c7180ed786224/log.txt.gz 2026-05-10 16:46:09,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:09,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:09,246 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62e379c7180ed786224/lava-logs.yaml 2026-05-10 16:46:09,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:09,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:09,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62e379c7180ed786224/lava_callback.json.gz 2026-05-10 16:46:09,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:09,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62e379c7180ed786224 HTTP/1.1" 200 None 2026-05-10 16:46:09,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:09,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:46:09,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:09,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b62e379c7180ed786224 HTTP/1.1" 200 None 2026-05-10 16:46:09,416 - lava_callback - INFO - Completed processing callback for node 6a00b62e379c7180ed786224 INFO: 172.21.0.1:52916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:46:18,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:18,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:46:45,298 - lava_callback - INFO - Received callback for node 6a00b62d379c7180ed786221 INFO: 172.21.0.1:39000 - "POST /node/6a00b62d379c7180ed786221 HTTP/1.0" 202 Accepted 2026-05-10 16:46:45,304 - lava_callback - INFO - Starting async job submit for node 6a00b62d379c7180ed786221 2026-05-10 16:46:45,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:45,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62d379c7180ed786221 HTTP/1.1" 200 None 2026-05-10 16:46:45,342 - lava_callback - DEBUG - Processing node 6a00b62d379c7180ed786221: baseline-arm 2026-05-10 16:46:45,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:45,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:45,666 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62d379c7180ed786221/log.txt.gz 2026-05-10 16:46:45,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:45,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:45,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62d379c7180ed786221/lava-logs.yaml 2026-05-10 16:46:45,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:46:46,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:46:46,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62d379c7180ed786221/lava_callback.json.gz 2026-05-10 16:46:46,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:46,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62d379c7180ed786221 HTTP/1.1" 200 None 2026-05-10 16:46:46,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:46,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:46:46,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:46,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b62d379c7180ed786221 HTTP/1.1" 200 None 2026-05-10 16:46:46,198 - lava_callback - INFO - Completed processing callback for node 6a00b62d379c7180ed786221 INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:46:48,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:46:48,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:47:02,508 - lava_callback - INFO - Received callback for node 6a00b62a379c7180ed786215 INFO: 172.21.0.1:43742 - "POST /node/6a00b62a379c7180ed786215 HTTP/1.0" 202 Accepted 2026-05-10 16:47:02,514 - lava_callback - INFO - Starting async job submit for node 6a00b62a379c7180ed786215 2026-05-10 16:47:02,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:02,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62a379c7180ed786215 HTTP/1.1" 200 None 2026-05-10 16:47:02,550 - lava_callback - DEBUG - Processing node 6a00b62a379c7180ed786215: baseline-arm 2026-05-10 16:47:02,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:02,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:02,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62a379c7180ed786215/log.txt.gz 2026-05-10 16:47:02,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:03,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:03,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62a379c7180ed786215/lava-logs.yaml 2026-05-10 16:47:03,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:03,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:03,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62a379c7180ed786215/lava_callback.json.gz 2026-05-10 16:47:03,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:03,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62a379c7180ed786215 HTTP/1.1" 200 None 2026-05-10 16:47:03,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:03,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:47:03,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:03,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b62a379c7180ed786215 HTTP/1.1" 200 None 2026-05-10 16:47:03,305 - lava_callback - INFO - Completed processing callback for node 6a00b62a379c7180ed786215 INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:47:12,492 - lava_callback - INFO - Received callback for node 6a00b650379c7180ed7862ad INFO: 172.21.0.1:60460 - "POST /node/6a00b650379c7180ed7862ad HTTP/1.0" 202 Accepted 2026-05-10 16:47:12,541 - lava_callback - INFO - Starting async job submit for node 6a00b650379c7180ed7862ad 2026-05-10 16:47:12,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:12,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b650379c7180ed7862ad HTTP/1.1" 200 None 2026-05-10 16:47:12,577 - lava_callback - DEBUG - Processing node 6a00b650379c7180ed7862ad: baseline-arm-pengutronix 2026-05-10 16:47:12,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:12,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:12,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b650379c7180ed7862ad/log.txt.gz 2026-05-10 16:47:12,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:12,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:12,972 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b650379c7180ed7862ad/lava-logs.yaml 2026-05-10 16:47:12,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:13,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:13,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b650379c7180ed7862ad/lava_callback.json.gz 2026-05-10 16:47:13,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:13,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b650379c7180ed7862ad HTTP/1.1" 200 None 2026-05-10 16:47:13,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:13,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:47:13,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:13,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b650379c7180ed7862ad HTTP/1.1" 200 None 2026-05-10 16:47:13,168 - lava_callback - INFO - Completed processing callback for node 6a00b650379c7180ed7862ad INFO: 172.21.0.1:60464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:47:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:18,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:47:31,482 - lava_callback - INFO - Received callback for node 6a00b64e379c7180ed7862a7 INFO: 172.21.0.1:59792 - "POST /node/6a00b64e379c7180ed7862a7 HTTP/1.0" 202 Accepted 2026-05-10 16:47:31,490 - lava_callback - INFO - Starting async job submit for node 6a00b64e379c7180ed7862a7 2026-05-10 16:47:31,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:31,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b64e379c7180ed7862a7 HTTP/1.1" 200 None 2026-05-10 16:47:31,539 - lava_callback - DEBUG - Processing node 6a00b64e379c7180ed7862a7: baseline-arm-pengutronix 2026-05-10 16:47:31,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:31,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:31,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64e379c7180ed7862a7/log.txt.gz 2026-05-10 16:47:31,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:32,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:32,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64e379c7180ed7862a7/lava-logs.yaml 2026-05-10 16:47:32,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:32,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:32,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64e379c7180ed7862a7/lava_callback.json.gz 2026-05-10 16:47:32,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:32,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b64e379c7180ed7862a7 HTTP/1.1" 200 None 2026-05-10 16:47:32,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:32,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:47:32,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:32,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b64e379c7180ed7862a7 HTTP/1.1" 200 None 2026-05-10 16:47:32,382 - lava_callback - INFO - Completed processing callback for node 6a00b64e379c7180ed7862a7 INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57404 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:47:48,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:48,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 16:47:54,663 - lava_callback - INFO - Received callback for node 6a00b641379c7180ed78625d INFO: 172.21.0.1:33458 - "POST /node/6a00b641379c7180ed78625d HTTP/1.0" 202 Accepted 2026-05-10 16:47:54,701 - lava_callback - INFO - Starting async job submit for node 6a00b641379c7180ed78625d 2026-05-10 16:47:54,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:54,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b641379c7180ed78625d HTTP/1.1" 200 None 2026-05-10 16:47:54,868 - lava_callback - DEBUG - Processing node 6a00b641379c7180ed78625d: baseline-arm-clabbe 2026-05-10 16:47:55,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:55,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:55,592 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b641379c7180ed78625d/log.txt.gz 2026-05-10 16:47:55,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:56,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:56,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b641379c7180ed78625d/lava-logs.yaml 2026-05-10 16:47:56,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:47:56,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:47:56,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b641379c7180ed78625d/lava_callback.json.gz 2026-05-10 16:47:56,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:56,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b641379c7180ed78625d HTTP/1.1" 200 None 2026-05-10 16:47:56,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:56,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:47:56,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:47:56,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b641379c7180ed78625d HTTP/1.1" 200 None 2026-05-10 16:47:56,501 - lava_callback - INFO - Completed processing callback for node 6a00b641379c7180ed78625d INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:48:12,373 - lava_callback - INFO - Received callback for node 6a00b66a379c7180ed7862dd INFO: 172.21.0.1:43246 - "POST /node/6a00b66a379c7180ed7862dd HTTP/1.0" 202 Accepted 2026-05-10 16:48:12,384 - lava_callback - INFO - Starting async job submit for node 6a00b66a379c7180ed7862dd 2026-05-10 16:48:12,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:12,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b66a379c7180ed7862dd HTTP/1.1" 200 None 2026-05-10 16:48:12,479 - lava_callback - DEBUG - Processing node 6a00b66a379c7180ed7862dd: ltp-dio 2026-05-10 16:48:13,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:13,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:13,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-6a00b66a379c7180ed7862dd/log.txt.gz 2026-05-10 16:48:14,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:14,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:14,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-6a00b66a379c7180ed7862dd/lava-logs.yaml 2026-05-10 16:48:14,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:14,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:14,759 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-6a00b66a379c7180ed7862dd/lava_callback.json.gz 2026-05-10 16:48:14,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:14,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b66a379c7180ed7862dd HTTP/1.1" 200 None 2026-05-10 16:48:14,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:14,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:48:14,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:14,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b66a379c7180ed7862dd HTTP/1.1" 200 None 2026-05-10 16:48:14,907 - lava_callback - INFO - Completed processing callback for node 6a00b66a379c7180ed7862dd INFO: 172.21.0.1:43252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:48:18,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:18,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 16:48:20,241 - lava_callback - INFO - Received callback for node 6a00b649379c7180ed786292 INFO: 172.21.0.1:47978 - "POST /node/6a00b649379c7180ed786292 HTTP/1.0" 202 Accepted 2026-05-10 16:48:20,255 - lava_callback - INFO - Starting async job submit for node 6a00b649379c7180ed786292 2026-05-10 16:48:20,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:20,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b649379c7180ed786292 HTTP/1.1" 200 None 2026-05-10 16:48:20,332 - lava_callback - DEBUG - Processing node 6a00b649379c7180ed786292: baseline-arm-kontron 2026-05-10 16:48:20,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:20,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:20,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a00b649379c7180ed786292/log.txt.gz 2026-05-10 16:48:21,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:21,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:21,364 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a00b649379c7180ed786292/lava-logs.yaml 2026-05-10 16:48:21,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:21,389 - lava_callback - INFO - Received callback for node 6a00b64a379c7180ed786295 2026-05-10 16:48:21,405 - lava_callback - INFO - Starting async job submit for node 6a00b64a379c7180ed786295 INFO: 172.21.0.1:47990 - "POST /node/6a00b64a379c7180ed786295 HTTP/1.0" 202 Accepted 2026-05-10 16:48:21,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:21,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b64a379c7180ed786295 HTTP/1.1" 200 None 2026-05-10 16:48:21,479 - lava_callback - DEBUG - Processing node 6a00b64a379c7180ed786295: baseline-arm-kontron 2026-05-10 16:48:21,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:21,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a00b649379c7180ed786292/lava_callback.json.gz 2026-05-10 16:48:21,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:21,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b649379c7180ed786292 HTTP/1.1" 200 None 2026-05-10 16:48:21,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:21,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:48:21,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:22,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:22,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b649379c7180ed786292 HTTP/1.1" 200 None 2026-05-10 16:48:22,016 - lava_callback - INFO - Completed processing callback for node 6a00b649379c7180ed786292 2026-05-10 16:48:22,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:22,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a00b64a379c7180ed786295/log.txt.gz 2026-05-10 16:48:22,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:22,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:22,906 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a00b64a379c7180ed786295/lava-logs.yaml 2026-05-10 16:48:22,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:23,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:23,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a00b64a379c7180ed786295/lava_callback.json.gz 2026-05-10 16:48:23,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:23,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b64a379c7180ed786295 HTTP/1.1" 200 None 2026-05-10 16:48:23,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:23,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:48:23,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:23,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b64a379c7180ed786295 HTTP/1.1" 200 None 2026-05-10 16:48:23,385 - lava_callback - INFO - Completed processing callback for node 6a00b64a379c7180ed786295 INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:48:31,145 - lava_callback - INFO - Received callback for node 6a00b64d379c7180ed7862a4 INFO: 172.21.0.1:52080 - "POST /node/6a00b64d379c7180ed7862a4 HTTP/1.0" 202 Accepted 2026-05-10 16:48:31,156 - lava_callback - INFO - Starting async job submit for node 6a00b64d379c7180ed7862a4 2026-05-10 16:48:31,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:31,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b64d379c7180ed7862a4 HTTP/1.1" 200 None 2026-05-10 16:48:31,228 - lava_callback - DEBUG - Processing node 6a00b64d379c7180ed7862a4: baseline-arm-pengutronix 2026-05-10 16:48:31,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:31,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:31,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64d379c7180ed7862a4/log.txt.gz 2026-05-10 16:48:31,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:31,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:31,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64d379c7180ed7862a4/lava-logs.yaml 2026-05-10 16:48:31,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:32,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:32,102 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64d379c7180ed7862a4/lava_callback.json.gz 2026-05-10 16:48:32,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:32,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b64d379c7180ed7862a4 HTTP/1.1" 200 None 2026-05-10 16:48:32,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:32,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:48:32,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:32,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b64d379c7180ed7862a4 HTTP/1.1" 200 None 2026-05-10 16:48:32,208 - lava_callback - INFO - Completed processing callback for node 6a00b64d379c7180ed7862a4 INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:48:43,909 - lava_callback - INFO - Received callback for node 6a00b642379c7180ed78627d INFO: 172.21.0.1:53586 - "POST /node/6a00b642379c7180ed78627d HTTP/1.0" 202 Accepted 2026-05-10 16:48:43,916 - lava_callback - INFO - Starting async job submit for node 6a00b642379c7180ed78627d 2026-05-10 16:48:43,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:43,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b642379c7180ed78627d HTTP/1.1" 200 None 2026-05-10 16:48:43,983 - lava_callback - DEBUG - Processing node 6a00b642379c7180ed78627d: baseline-arm-clabbe 2026-05-10 16:48:44,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:44,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:44,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b642379c7180ed78627d/log.txt.gz 2026-05-10 16:48:44,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:44,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:44,673 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b642379c7180ed78627d/lava-logs.yaml 2026-05-10 16:48:44,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:44,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:44,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b642379c7180ed78627d/lava_callback.json.gz 2026-05-10 16:48:44,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:44,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b642379c7180ed78627d HTTP/1.1" 200 None 2026-05-10 16:48:44,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:44,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:48:44,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:44,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b642379c7180ed78627d HTTP/1.1" 200 None 2026-05-10 16:48:44,991 - lava_callback - INFO - Completed processing callback for node 6a00b642379c7180ed78627d INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:48:48,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:48,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 16:48:54,271 - lava_callback - INFO - Received callback for node 6a00b6db379c7180ed786377 INFO: 172.21.0.1:39294 - "POST /node/6a00b6db379c7180ed786377 HTTP/1.0" 202 Accepted 2026-05-10 16:48:54,281 - lava_callback - INFO - Starting async job submit for node 6a00b6db379c7180ed786377 2026-05-10 16:48:54,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:54,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6db379c7180ed786377 HTTP/1.1" 200 None 2026-05-10 16:48:54,395 - lava_callback - DEBUG - Processing node 6a00b6db379c7180ed786377: baseline-arm64 2026-05-10 16:48:54,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:54,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:54,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6db379c7180ed786377/log.txt.gz 2026-05-10 16:48:55,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:55,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:55,195 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6db379c7180ed786377/lava-logs.yaml 2026-05-10 16:48:55,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:48:55,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:48:55,323 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6db379c7180ed786377/lava_callback.json.gz 2026-05-10 16:48:55,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:55,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6db379c7180ed786377 HTTP/1.1" 200 None 2026-05-10 16:48:55,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:55,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:48:55,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:48:55,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6db379c7180ed786377 HTTP/1.1" 200 None 2026-05-10 16:48:55,437 - lava_callback - INFO - Completed processing callback for node 6a00b6db379c7180ed786377 INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:49:09,706 - lava_callback - INFO - Received callback for node 6a00b6f5379c7180ed7863d6 INFO: 172.21.0.1:41942 - "POST /node/6a00b6f5379c7180ed7863d6 HTTP/1.0" 202 Accepted 2026-05-10 16:49:09,716 - lava_callback - INFO - Starting async job submit for node 6a00b6f5379c7180ed7863d6 2026-05-10 16:49:09,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:09,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f5379c7180ed7863d6 HTTP/1.1" 200 None 2026-05-10 16:49:09,737 - lava_callback - DEBUG - Processing node 6a00b6f5379c7180ed7863d6: baseline-nfs-arm64 2026-05-10 16:49:09,739 - lava_callback - WARNING - Failed to upload log 2026-05-10 16:49:09,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:09,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:09,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f5379c7180ed7863d6/lava-logs.yaml 2026-05-10 16:49:09,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:09,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:09,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f5379c7180ed7863d6/lava_callback.json.gz 2026-05-10 16:49:09,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:09,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f5379c7180ed7863d6 HTTP/1.1" 200 None 2026-05-10 16:49:09,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:09,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:49:09,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:10,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6f5379c7180ed7863d6 HTTP/1.1" 200 None 2026-05-10 16:49:10,035 - lava_callback - INFO - Completed processing callback for node 6a00b6f5379c7180ed7863d6 2026-05-10 16:49:14,925 - lava_callback - INFO - Received callback for node 6a00b6e7379c7180ed7863a1 INFO: 172.21.0.1:41946 - "POST /node/6a00b6e7379c7180ed7863a1 HTTP/1.0" 202 Accepted 2026-05-10 16:49:14,936 - lava_callback - INFO - Starting async job submit for node 6a00b6e7379c7180ed7863a1 2026-05-10 16:49:14,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:14,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e7379c7180ed7863a1 HTTP/1.1" 200 None 2026-05-10 16:49:14,982 - lava_callback - DEBUG - Processing node 6a00b6e7379c7180ed7863a1: baseline-arm64 INFO: 172.21.0.1:41958 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 16:49:15,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:15,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:15,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e7379c7180ed7863a1/log.txt.gz 2026-05-10 16:49:15,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:15,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:15,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e7379c7180ed7863a1/lava-logs.yaml 2026-05-10 16:49:15,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:15,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:15,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e7379c7180ed7863a1/lava_callback.json.gz 2026-05-10 16:49:15,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:15,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e7379c7180ed7863a1 HTTP/1.1" 200 None 2026-05-10 16:49:15,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:15,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:49:15,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:15,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6e7379c7180ed7863a1 HTTP/1.1" 200 None 2026-05-10 16:49:15,872 - lava_callback - INFO - Completed processing callback for node 6a00b6e7379c7180ed7863a1 INFO: 172.21.0.1:41966 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:49:18,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:18,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 16:49:19,892 - lava_callback - INFO - Received callback for node 6a00b707379c7180ed78642b INFO: 172.21.0.1:50862 - "POST /node/6a00b707379c7180ed78642b HTTP/1.0" 202 Accepted 2026-05-10 16:49:19,900 - lava_callback - INFO - Starting async job submit for node 6a00b707379c7180ed78642b 2026-05-10 16:49:19,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:19,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b707379c7180ed78642b HTTP/1.1" 200 None 2026-05-10 16:49:19,920 - lava_callback - DEBUG - Processing node 6a00b707379c7180ed78642b: baseline-arm 2026-05-10 16:49:19,927 - lava_callback - WARNING - Failed to upload log 2026-05-10 16:49:19,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:20,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:20,008 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b707379c7180ed78642b/lava-logs.yaml 2026-05-10 16:49:20,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:20,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:20,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b707379c7180ed78642b/lava_callback.json.gz 2026-05-10 16:49:20,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:20,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b707379c7180ed78642b HTTP/1.1" 200 None 2026-05-10 16:49:20,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:20,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:49:20,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:20,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b707379c7180ed78642b HTTP/1.1" 200 None 2026-05-10 16:49:20,198 - lava_callback - INFO - Completed processing callback for node 6a00b707379c7180ed78642b INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:49:37,480 - lava_callback - INFO - Received callback for node 6a00b6e4379c7180ed786393 INFO: 172.21.0.1:56854 - "POST /node/6a00b6e4379c7180ed786393 HTTP/1.0" 202 Accepted 2026-05-10 16:49:37,487 - lava_callback - INFO - Starting async job submit for node 6a00b6e4379c7180ed786393 2026-05-10 16:49:37,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:37,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e4379c7180ed786393 HTTP/1.1" 200 None 2026-05-10 16:49:37,531 - lava_callback - DEBUG - Processing node 6a00b6e4379c7180ed786393: baseline-arm64 2026-05-10 16:49:38,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:38,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:38,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e4379c7180ed786393/log.txt.gz 2026-05-10 16:49:38,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:38,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:38,570 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e4379c7180ed786393/lava-logs.yaml 2026-05-10 16:49:38,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:38,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:38,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e4379c7180ed786393/lava_callback.json.gz 2026-05-10 16:49:38,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:38,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e4379c7180ed786393 HTTP/1.1" 200 None 2026-05-10 16:49:38,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:38,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:49:38,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:38,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6e4379c7180ed786393 HTTP/1.1" 200 None 2026-05-10 16:49:38,863 - lava_callback - INFO - Completed processing callback for node 6a00b6e4379c7180ed786393 2026-05-10 16:49:39,381 - lava_callback - INFO - Received callback for node 6a00b6df379c7180ed786383 INFO: 172.21.0.1:56860 - "POST /node/6a00b6df379c7180ed786383 HTTP/1.0" 202 Accepted 2026-05-10 16:49:39,388 - lava_callback - INFO - Starting async job submit for node 6a00b6df379c7180ed786383 2026-05-10 16:49:39,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:39,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6df379c7180ed786383 HTTP/1.1" 200 None 2026-05-10 16:49:39,445 - lava_callback - DEBUG - Processing node 6a00b6df379c7180ed786383: baseline-arm64 2026-05-10 16:49:39,626 - lava_callback - WARNING - Failed to upload log 2026-05-10 16:49:39,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:39,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:39,795 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6df379c7180ed786383/lava-logs.yaml 2026-05-10 16:49:39,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:39,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:39,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6df379c7180ed786383/lava_callback.json.gz 2026-05-10 16:49:39,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:39,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6df379c7180ed786383 HTTP/1.1" 200 None 2026-05-10 16:49:39,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:39,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:49:39,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:39,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6df379c7180ed786383 HTTP/1.1" 200 None 2026-05-10 16:49:40,025 - lava_callback - INFO - Completed processing callback for node 6a00b6df379c7180ed786383 2026-05-10 16:49:40,630 - lava_callback - INFO - Received callback for node 6a00b6dd379c7180ed78637d INFO: 172.21.0.1:34762 - "POST /node/6a00b6dd379c7180ed78637d HTTP/1.0" 202 Accepted 2026-05-10 16:49:40,636 - lava_callback - INFO - Starting async job submit for node 6a00b6dd379c7180ed78637d 2026-05-10 16:49:40,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:40,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6dd379c7180ed78637d HTTP/1.1" 200 None 2026-05-10 16:49:40,684 - lava_callback - DEBUG - Processing node 6a00b6dd379c7180ed78637d: baseline-arm64 2026-05-10 16:49:40,859 - lava_callback - INFO - Received callback for node 6a00b6e0379c7180ed78638a INFO: 172.21.0.1:34774 - "POST /node/6a00b6e0379c7180ed78638a HTTP/1.0" 202 Accepted 2026-05-10 16:49:40,871 - lava_callback - INFO - Starting async job submit for node 6a00b6e0379c7180ed78638a 2026-05-10 16:49:40,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:41,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:41,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e0379c7180ed78638a HTTP/1.1" 200 None 2026-05-10 16:49:41,006 - lava_callback - DEBUG - Processing node 6a00b6e0379c7180ed78638a: baseline-arm64 2026-05-10 16:49:41,171 - lava_callback - WARNING - Failed to upload log 2026-05-10 16:49:41,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:41,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:41,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dd379c7180ed78637d/log.txt.gz 2026-05-10 16:49:41,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:41,629 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e0379c7180ed78638a/lava-logs.yaml 2026-05-10 16:49:41,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:41,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:41,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:41,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e0379c7180ed78638a/lava_callback.json.gz 2026-05-10 16:49:41,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:41,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e0379c7180ed78638a HTTP/1.1" 200 None 2026-05-10 16:49:41,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:41,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:49:41,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:41,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6e0379c7180ed78638a HTTP/1.1" 200 None 2026-05-10 16:49:41,956 - lava_callback - INFO - Completed processing callback for node 6a00b6e0379c7180ed78638a 2026-05-10 16:49:41,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:41,997 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dd379c7180ed78637d/lava-logs.yaml 2026-05-10 16:49:42,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:42,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:42,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dd379c7180ed78637d/lava_callback.json.gz 2026-05-10 16:49:42,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:42,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6dd379c7180ed78637d HTTP/1.1" 200 None 2026-05-10 16:49:42,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:42,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:49:42,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:42,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6dd379c7180ed78637d HTTP/1.1" 200 None 2026-05-10 16:49:42,232 - lava_callback - INFO - Completed processing callback for node 6a00b6dd379c7180ed78637d 2026-05-10 16:49:43,826 - lava_callback - INFO - Received callback for node 6a00b6e8379c7180ed7863a4 INFO: 172.21.0.1:34782 - "POST /node/6a00b6e8379c7180ed7863a4 HTTP/1.0" 202 Accepted 2026-05-10 16:49:43,832 - lava_callback - INFO - Starting async job submit for node 6a00b6e8379c7180ed7863a4 2026-05-10 16:49:43,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:43,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e8379c7180ed7863a4 HTTP/1.1" 200 None 2026-05-10 16:49:43,869 - lava_callback - DEBUG - Processing node 6a00b6e8379c7180ed7863a4: baseline-arm64 2026-05-10 16:49:44,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:44,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:44,187 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e8379c7180ed7863a4/log.txt.gz 2026-05-10 16:49:44,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:44,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:44,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e8379c7180ed7863a4/lava-logs.yaml 2026-05-10 16:49:44,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:44,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:44,622 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e8379c7180ed7863a4/lava_callback.json.gz 2026-05-10 16:49:44,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:44,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e8379c7180ed7863a4 HTTP/1.1" 200 None 2026-05-10 16:49:44,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:44,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:49:44,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:44,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6e8379c7180ed7863a4 HTTP/1.1" 200 None 2026-05-10 16:49:44,704 - lava_callback - INFO - Completed processing callback for node 6a00b6e8379c7180ed7863a4 INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:49:48,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:48,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 16:49:52,463 - lava_callback - INFO - Received callback for node 6a00b28e379c7180ed7860fb INFO: 172.21.0.1:51368 - "POST /node/6a00b28e379c7180ed7860fb HTTP/1.0" 202 Accepted 2026-05-10 16:49:52,478 - lava_callback - INFO - Starting async job submit for node 6a00b28e379c7180ed7860fb 2026-05-10 16:49:52,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:52,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b28e379c7180ed7860fb HTTP/1.1" 200 None 2026-05-10 16:49:52,636 - lava_callback - DEBUG - Processing node 6a00b28e379c7180ed7860fb: ltp-smoke 2026-05-10 16:49:53,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:53,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:53,807 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b28e379c7180ed7860fb/log.txt.gz 2026-05-10 16:49:54,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:54,667 - lava_callback - INFO - Received callback for node 6a00b646379c7180ed78628c INFO: 172.21.0.1:51370 - "POST /node/6a00b646379c7180ed78628c HTTP/1.0" 202 Accepted 2026-05-10 16:49:54,690 - lava_callback - INFO - Starting async job submit for node 6a00b646379c7180ed78628c 2026-05-10 16:49:54,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:54,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b646379c7180ed78628c HTTP/1.1" 200 None 2026-05-10 16:49:54,769 - lava_callback - DEBUG - Processing node 6a00b646379c7180ed78628c: baseline-arm-clabbe 2026-05-10 16:49:54,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:54,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b28e379c7180ed7860fb/lava-logs.yaml 2026-05-10 16:49:54,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:55,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:55,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b28e379c7180ed7860fb/lava_callback.json.gz 2026-05-10 16:49:55,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:55,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:55,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b28e379c7180ed7860fb HTTP/1.1" 200 None 2026-05-10 16:49:55,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:55,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:55,521 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b646379c7180ed78628c/log.txt.gz 2026-05-10 16:49:55,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af89379c7180ed783980 HTTP/1.1" 200 None 2026-05-10 16:49:55,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:55,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b28e379c7180ed7860fb HTTP/1.1" 200 None 2026-05-10 16:49:55,952 - lava_callback - INFO - Completed processing callback for node 6a00b28e379c7180ed7860fb 2026-05-10 16:49:56,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:56,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:56,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b646379c7180ed78628c/lava-logs.yaml 2026-05-10 16:49:56,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:49:56,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:49:56,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a00b646379c7180ed78628c/lava_callback.json.gz INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:49:56,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:56,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b646379c7180ed78628c HTTP/1.1" 200 None 2026-05-10 16:49:56,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:56,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:49:56,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:49:56,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b646379c7180ed78628c HTTP/1.1" 200 None 2026-05-10 16:49:56,659 - lava_callback - INFO - Completed processing callback for node 6a00b646379c7180ed78628c 2026-05-10 16:50:00,159 - lava_callback - INFO - Received callback for node 6a00b6dc379c7180ed78637a INFO: 172.21.0.1:58262 - "POST /node/6a00b6dc379c7180ed78637a HTTP/1.0" 202 Accepted 2026-05-10 16:50:00,172 - lava_callback - INFO - Starting async job submit for node 6a00b6dc379c7180ed78637a 2026-05-10 16:50:00,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:00,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6dc379c7180ed78637a HTTP/1.1" 200 None 2026-05-10 16:50:00,252 - lava_callback - DEBUG - Processing node 6a00b6dc379c7180ed78637a: baseline-arm64 2026-05-10 16:50:00,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:01,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:01,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dc379c7180ed78637a/log.txt.gz 2026-05-10 16:50:01,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:01,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:01,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dc379c7180ed78637a/lava-logs.yaml 2026-05-10 16:50:01,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:01,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:01,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dc379c7180ed78637a/lava_callback.json.gz 2026-05-10 16:50:01,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:01,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6dc379c7180ed78637a HTTP/1.1" 200 None 2026-05-10 16:50:01,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:01,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:01,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:01,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6dc379c7180ed78637a HTTP/1.1" 200 None 2026-05-10 16:50:01,958 - lava_callback - INFO - Completed processing callback for node 6a00b6dc379c7180ed78637a 2026-05-10 16:50:02,023 - lava_callback - INFO - Received callback for node 6a00b6e5379c7180ed78639b INFO: 172.21.0.1:58266 - "POST /node/6a00b6e5379c7180ed78639b HTTP/1.0" 202 Accepted 2026-05-10 16:50:02,048 - lava_callback - INFO - Starting async job submit for node 6a00b6e5379c7180ed78639b 2026-05-10 16:50:02,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:02,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e5379c7180ed78639b HTTP/1.1" 200 None 2026-05-10 16:50:02,139 - lava_callback - DEBUG - Processing node 6a00b6e5379c7180ed78639b: baseline-arm64 2026-05-10 16:50:02,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:02,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:02,963 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e5379c7180ed78639b/log.txt.gz 2026-05-10 16:50:03,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:03,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:03,440 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e5379c7180ed78639b/lava-logs.yaml 2026-05-10 16:50:03,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:03,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:03,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e5379c7180ed78639b/lava_callback.json.gz 2026-05-10 16:50:03,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:03,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e5379c7180ed78639b HTTP/1.1" 200 None 2026-05-10 16:50:03,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:03,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:03,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:03,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6e5379c7180ed78639b HTTP/1.1" 200 None 2026-05-10 16:50:03,647 - lava_callback - INFO - Completed processing callback for node 6a00b6e5379c7180ed78639b INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:50:10,987 - lava_callback - INFO - Received callback for node 6a00b6e2379c7180ed786390 INFO: 172.21.0.1:45258 - "POST /node/6a00b6e2379c7180ed786390 HTTP/1.0" 202 Accepted 2026-05-10 16:50:10,998 - lava_callback - INFO - Starting async job submit for node 6a00b6e2379c7180ed786390 2026-05-10 16:50:11,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:11,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e2379c7180ed786390 HTTP/1.1" 200 None 2026-05-10 16:50:11,092 - lava_callback - DEBUG - Processing node 6a00b6e2379c7180ed786390: baseline-arm64 2026-05-10 16:50:11,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:11,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:11,951 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e2379c7180ed786390/log.txt.gz 2026-05-10 16:50:12,098 - lava_callback - INFO - Received callback for node 6a00b63b379c7180ed786246 INFO: 172.21.0.1:45272 - "POST /node/6a00b63b379c7180ed786246 HTTP/1.0" 202 Accepted 2026-05-10 16:50:12,128 - lava_callback - INFO - Starting async job submit for node 6a00b63b379c7180ed786246 2026-05-10 16:50:12,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:12,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b63b379c7180ed786246 HTTP/1.1" 200 None 2026-05-10 16:50:12,275 - lava_callback - DEBUG - Processing node 6a00b63b379c7180ed786246: baseline-arm-broonie 2026-05-10 16:50:12,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:12,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:12,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:12,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e2379c7180ed786390/lava-logs.yaml 2026-05-10 16:50:12,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:13,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:13,058 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63b379c7180ed786246/log.txt.gz 2026-05-10 16:50:13,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:13,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e2379c7180ed786390/lava_callback.json.gz 2026-05-10 16:50:13,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:13,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:13,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e2379c7180ed786390 HTTP/1.1" 200 None 2026-05-10 16:50:13,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:13,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:13,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:13,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6e2379c7180ed786390 HTTP/1.1" 200 None 2026-05-10 16:50:13,484 - lava_callback - INFO - Completed processing callback for node 6a00b6e2379c7180ed786390 2026-05-10 16:50:13,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:13,990 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63b379c7180ed786246/lava-logs.yaml 2026-05-10 16:50:13,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:14,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:14,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63b379c7180ed786246/lava_callback.json.gz 2026-05-10 16:50:14,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:14,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b63b379c7180ed786246 HTTP/1.1" 200 None 2026-05-10 16:50:14,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:14,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:50:14,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:14,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b63b379c7180ed786246 HTTP/1.1" 200 None 2026-05-10 16:50:14,483 - lava_callback - INFO - Completed processing callback for node 6a00b63b379c7180ed786246 2026-05-10 16:50:14,761 - lava_callback - INFO - Received callback for node 6a00b6f9379c7180ed78640b INFO: 172.21.0.1:45284 - "POST /node/6a00b6f9379c7180ed78640b HTTP/1.0" 202 Accepted 2026-05-10 16:50:14,776 - lava_callback - INFO - Starting async job submit for node 6a00b6f9379c7180ed78640b 2026-05-10 16:50:14,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:14,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f9379c7180ed78640b HTTP/1.1" 200 None 2026-05-10 16:50:14,857 - lava_callback - DEBUG - Processing node 6a00b6f9379c7180ed78640b: baseline-nfs-arm64 2026-05-10 16:50:15,139 - lava_callback - INFO - Received callback for node 6a00b6e9379c7180ed7863a7 INFO: 172.21.0.1:45288 - "POST /node/6a00b6e9379c7180ed7863a7 HTTP/1.0" 202 Accepted 2026-05-10 16:50:15,155 - lava_callback - INFO - Starting async job submit for node 6a00b6e9379c7180ed7863a7 INFO: 172.21.0.1:45304 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 16:50:15,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:15,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e9379c7180ed7863a7 HTTP/1.1" 200 None 2026-05-10 16:50:15,314 - lava_callback - DEBUG - Processing node 6a00b6e9379c7180ed7863a7: baseline-arm64 2026-05-10 16:50:15,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:16,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:16,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:16,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f9379c7180ed78640b/log.txt.gz INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:50:16,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:16,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:16,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e9379c7180ed7863a7/log.txt.gz 2026-05-10 16:50:17,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:17,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:17,355 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f9379c7180ed78640b/lava-logs.yaml 2026-05-10 16:50:17,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:17,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:17,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e9379c7180ed7863a7/lava-logs.yaml 2026-05-10 16:50:17,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:17,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:17,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f9379c7180ed78640b/lava_callback.json.gz 2026-05-10 16:50:17,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:17,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f9379c7180ed78640b HTTP/1.1" 200 None 2026-05-10 16:50:17,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:17,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:17,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e9379c7180ed7863a7/lava_callback.json.gz 2026-05-10 16:50:17,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:17,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:17,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:17,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e9379c7180ed7863a7 HTTP/1.1" 200 None 2026-05-10 16:50:17,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:17,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6f9379c7180ed78640b HTTP/1.1" 200 None 2026-05-10 16:50:17,964 - lava_callback - INFO - Completed processing callback for node 6a00b6f9379c7180ed78640b 2026-05-10 16:50:17,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:17,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:18,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6e9379c7180ed7863a7 HTTP/1.1" 200 None 2026-05-10 16:50:18,074 - lava_callback - INFO - Completed processing callback for node 6a00b6e9379c7180ed7863a7 2026-05-10 16:50:18,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:18,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 16:50:19,361 - lava_callback - INFO - Received callback for node 6a00b6ec379c7180ed7863ad INFO: 172.21.0.1:45326 - "POST /node/6a00b6ec379c7180ed7863ad HTTP/1.0" 202 Accepted 2026-05-10 16:50:19,383 - lava_callback - INFO - Starting async job submit for node 6a00b6ec379c7180ed7863ad 2026-05-10 16:50:19,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:19,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6ec379c7180ed7863ad HTTP/1.1" 200 None 2026-05-10 16:50:19,461 - lava_callback - DEBUG - Processing node 6a00b6ec379c7180ed7863ad: baseline-arm64 2026-05-10 16:50:20,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:20,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:20,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6ec379c7180ed7863ad/log.txt.gz 2026-05-10 16:50:20,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:21,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:21,400 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6ec379c7180ed7863ad/lava-logs.yaml 2026-05-10 16:50:21,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:21,592 - lava_callback - INFO - Received callback for node 6a00b6f8379c7180ed786408 INFO: 172.21.0.1:40772 - "POST /node/6a00b6f8379c7180ed786408 HTTP/1.0" 202 Accepted 2026-05-10 16:50:21,614 - lava_callback - INFO - Starting async job submit for node 6a00b6f8379c7180ed786408 2026-05-10 16:50:21,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:21,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f8379c7180ed786408 HTTP/1.1" 200 None 2026-05-10 16:50:21,696 - lava_callback - DEBUG - Processing node 6a00b6f8379c7180ed786408: baseline-nfs-arm64 2026-05-10 16:50:21,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:21,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6ec379c7180ed7863ad/lava_callback.json.gz 2026-05-10 16:50:22,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:22,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6ec379c7180ed7863ad HTTP/1.1" 200 None 2026-05-10 16:50:22,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:22,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:22,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:22,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6ec379c7180ed7863ad HTTP/1.1" 200 None 2026-05-10 16:50:22,287 - lava_callback - INFO - Completed processing callback for node 6a00b6ec379c7180ed7863ad 2026-05-10 16:50:22,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:22,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:22,887 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f8379c7180ed786408/log.txt.gz 2026-05-10 16:50:23,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:23,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:23,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f8379c7180ed786408/lava-logs.yaml 2026-05-10 16:50:23,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:24,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:24,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f8379c7180ed786408/lava_callback.json.gz 2026-05-10 16:50:24,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:24,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f8379c7180ed786408 HTTP/1.1" 200 None 2026-05-10 16:50:24,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:24,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:24,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:24,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6f8379c7180ed786408 HTTP/1.1" 200 None 2026-05-10 16:50:24,301 - lava_callback - INFO - Completed processing callback for node 6a00b6f8379c7180ed786408 2026-05-10 16:50:26,195 - lava_callback - INFO - Received callback for node 6a00b6eb379c7180ed7863aa INFO: 172.21.0.1:40784 - "POST /node/6a00b6eb379c7180ed7863aa HTTP/1.0" 202 Accepted 2026-05-10 16:50:26,206 - lava_callback - INFO - Starting async job submit for node 6a00b6eb379c7180ed7863aa 2026-05-10 16:50:26,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:26,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6eb379c7180ed7863aa HTTP/1.1" 200 None 2026-05-10 16:50:26,282 - lava_callback - DEBUG - Processing node 6a00b6eb379c7180ed7863aa: baseline-arm64 INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:50:26,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:27,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:27,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6eb379c7180ed7863aa/log.txt.gz 2026-05-10 16:50:27,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:27,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:27,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6eb379c7180ed7863aa/lava-logs.yaml 2026-05-10 16:50:27,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:28,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:28,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6eb379c7180ed7863aa/lava_callback.json.gz 2026-05-10 16:50:28,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:28,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6eb379c7180ed7863aa HTTP/1.1" 200 None 2026-05-10 16:50:28,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:28,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:28,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:28,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6eb379c7180ed7863aa HTTP/1.1" 200 None 2026-05-10 16:50:28,458 - lava_callback - INFO - Completed processing callback for node 6a00b6eb379c7180ed7863aa 2026-05-10 16:50:30,784 - lava_callback - INFO - Received callback for node 6a00b6fa379c7180ed78640e INFO: 172.21.0.1:46182 - "POST /node/6a00b6fa379c7180ed78640e HTTP/1.0" 202 Accepted 2026-05-10 16:50:30,800 - lava_callback - INFO - Starting async job submit for node 6a00b6fa379c7180ed78640e 2026-05-10 16:50:30,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:30,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6fa379c7180ed78640e HTTP/1.1" 200 None 2026-05-10 16:50:30,918 - lava_callback - DEBUG - Processing node 6a00b6fa379c7180ed78640e: baseline-nfs-arm64 2026-05-10 16:50:31,351 - lava_callback - INFO - Received callback for node 6a00b721379c7180ed78649a INFO: 172.21.0.1:46190 - "POST /node/6a00b721379c7180ed78649a HTTP/1.0" 202 Accepted 2026-05-10 16:50:31,381 - lava_callback - INFO - Starting async job submit for node 6a00b721379c7180ed78649a 2026-05-10 16:50:31,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:31,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b721379c7180ed78649a HTTP/1.1" 200 None 2026-05-10 16:50:31,528 - lava_callback - DEBUG - Processing node 6a00b721379c7180ed78649a: baseline-arm64-foundriesio 2026-05-10 16:50:31,547 - lava_callback - INFO - Received callback for node 6a00b6f3379c7180ed7863cf 2026-05-10 16:50:31,571 - lava_callback - INFO - Starting async job submit for node 6a00b6f3379c7180ed7863cf INFO: 172.21.0.1:46192 - "POST /node/6a00b6f3379c7180ed7863cf HTTP/1.0" 202 Accepted 2026-05-10 16:50:31,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:31,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f3379c7180ed7863cf HTTP/1.1" 200 None 2026-05-10 16:50:31,895 - lava_callback - DEBUG - Processing node 6a00b6f3379c7180ed7863cf: baseline-nfs-arm64 2026-05-10 16:50:32,037 - lava_callback - INFO - Received callback for node 6a00b6dd379c7180ed786380 2026-05-10 16:50:32,103 - lava_callback - INFO - Starting async job submit for node 6a00b6dd379c7180ed786380 INFO: 172.21.0.1:46200 - "POST /node/6a00b6dd379c7180ed786380 HTTP/1.0" 202 Accepted 2026-05-10 16:50:32,142 - lava_callback - INFO - Received callback for node 6a00b63c379c7180ed786249 2026-05-10 16:50:32,217 - lava_callback - INFO - Starting async job submit for node 6a00b63c379c7180ed786249 INFO: 172.21.0.1:46208 - "POST /node/6a00b63c379c7180ed786249 HTTP/1.0" 202 Accepted 2026-05-10 16:50:32,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:32,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:32,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6dd379c7180ed786380 HTTP/1.1" 200 None 2026-05-10 16:50:32,522 - lava_callback - DEBUG - Processing node 6a00b6dd379c7180ed786380: baseline-arm64 2026-05-10 16:50:32,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:32,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b63c379c7180ed786249 HTTP/1.1" 200 None 2026-05-10 16:50:32,770 - lava_callback - DEBUG - Processing node 6a00b63c379c7180ed786249: baseline-arm-broonie 2026-05-10 16:50:33,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:33,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6fa379c7180ed78640e/log.txt.gz 2026-05-10 16:50:33,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:34,005 - lava_callback - INFO - Received callback for node 6a00b71e379c7180ed786490 2026-05-10 16:50:34,058 - lava_callback - INFO - Starting async job submit for node 6a00b71e379c7180ed786490 INFO: 172.21.0.1:46210 - "POST /node/6a00b71e379c7180ed786490 HTTP/1.0" 202 Accepted 2026-05-10 16:50:34,081 - lava_callback - INFO - Received callback for node 6a00b70e379c7180ed78643f 2026-05-10 16:50:34,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:34,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00b721379c7180ed78649a/log.txt.gz 2026-05-10 16:50:34,334 - lava_callback - INFO - Starting async job submit for node 6a00b70e379c7180ed78643f INFO: 172.21.0.1:46226 - "POST /node/6a00b70e379c7180ed78643f HTTP/1.0" 202 Accepted 2026-05-10 16:50:34,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:34,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:34,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b71e379c7180ed786490 HTTP/1.1" 200 None 2026-05-10 16:50:34,707 - lava_callback - DEBUG - Processing node 6a00b71e379c7180ed786490: baseline-arm64-pengutronix 2026-05-10 16:50:34,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b70e379c7180ed78643f HTTP/1.1" 200 None 2026-05-10 16:50:34,918 - lava_callback - DEBUG - Processing node 6a00b70e379c7180ed78643f: baseline-arm64-broonie 2026-05-10 16:50:35,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:35,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:35,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:50:35,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:35,922 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dd379c7180ed786380/log.txt.gz 2026-05-10 16:50:35,973 - lava_callback - INFO - Received callback for node 6a00b6f4379c7180ed7863d3 2026-05-10 16:50:36,007 - lava_callback - INFO - Starting async job submit for node 6a00b6f4379c7180ed7863d3 INFO: 172.21.0.1:46248 - "POST /node/6a00b6f4379c7180ed7863d3 HTTP/1.0" 202 Accepted 2026-05-10 16:50:36,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:36,356 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63c379c7180ed786249/log.txt.gz 2026-05-10 16:50:36,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:50:36,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:36,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f4379c7180ed7863d3 HTTP/1.1" 200 None 2026-05-10 16:50:36,940 - lava_callback - DEBUG - Processing node 6a00b6f4379c7180ed7863d3: baseline-nfs-arm64 2026-05-10 16:50:37,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:37,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00b721379c7180ed78649a/lava-logs.yaml 2026-05-10 16:50:37,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:37,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:37,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:37,513 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6fa379c7180ed78640e/lava-logs.yaml 2026-05-10 16:50:37,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:37,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:37,741 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b71e379c7180ed786490/log.txt.gz 2026-05-10 16:50:37,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:37,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:37,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:37,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00b721379c7180ed78649a/lava_callback.json.gz 2026-05-10 16:50:38,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:38,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:38,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:38,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b721379c7180ed78649a HTTP/1.1" 200 None 2026-05-10 16:50:38,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:38,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:38,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:38,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:38,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f3379c7180ed7863cf/log.txt.gz 2026-05-10 16:50:38,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:38,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b721379c7180ed78649a HTTP/1.1" 200 None 2026-05-10 16:50:38,632 - lava_callback - INFO - Completed processing callback for node 6a00b721379c7180ed78649a 2026-05-10 16:50:38,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:38,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6fa379c7180ed78640e/lava_callback.json.gz 2026-05-10 16:50:38,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:38,850 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70e379c7180ed78643f/log.txt.gz 2026-05-10 16:50:38,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:38,969 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dd379c7180ed786380/lava-logs.yaml 2026-05-10 16:50:39,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:39,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:39,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:39,136 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63c379c7180ed786249/lava-logs.yaml 2026-05-10 16:50:39,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6fa379c7180ed78640e HTTP/1.1" 200 None 2026-05-10 16:50:39,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:39,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:39,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:39,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:39,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6fa379c7180ed78640e HTTP/1.1" 200 None 2026-05-10 16:50:39,581 - lava_callback - INFO - Completed processing callback for node 6a00b6fa379c7180ed78640e 2026-05-10 16:50:39,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:39,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b71e379c7180ed786490/lava-logs.yaml 2026-05-10 16:50:39,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:39,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:39,795 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6dd379c7180ed786380/lava_callback.json.gz 2026-05-10 16:50:39,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:39,971 - lava_callback - INFO - Received callback for node 6a00b71f379c7180ed786493 2026-05-10 16:50:39,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63c379c7180ed786249/lava_callback.json.gz INFO: 172.21.0.1:46102 - "POST /node/6a00b71f379c7180ed786493 HTTP/1.0" 202 Accepted 2026-05-10 16:50:40,001 - lava_callback - INFO - Starting async job submit for node 6a00b71f379c7180ed786493 2026-05-10 16:50:40,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:40,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:40,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b71e379c7180ed786490/lava_callback.json.gz 2026-05-10 16:50:40,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b71f379c7180ed786493 HTTP/1.1" 200 None 2026-05-10 16:50:40,329 - lava_callback - DEBUG - Processing node 6a00b71f379c7180ed786493: baseline-arm64-pengutronix 2026-05-10 16:50:40,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6dd379c7180ed786380 HTTP/1.1" 200 None 2026-05-10 16:50:40,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,452 - lava_callback - INFO - Received callback for node 6a00b71d379c7180ed78648d 2026-05-10 16:50:40,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b63c379c7180ed786249 HTTP/1.1" 200 None 2026-05-10 16:50:40,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:46110 - "POST /node/6a00b71d379c7180ed78648d HTTP/1.0" 202 Accepted 2026-05-10 16:50:40,489 - lava_callback - INFO - Starting async job submit for node 6a00b71d379c7180ed78648d 2026-05-10 16:50:40,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:40,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:50:40,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b71e379c7180ed786490 HTTP/1.1" 200 None 2026-05-10 16:50:40,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:40,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b63c379c7180ed786249 HTTP/1.1" 200 None 2026-05-10 16:50:40,887 - lava_callback - INFO - Completed processing callback for node 6a00b63c379c7180ed786249 2026-05-10 16:50:40,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6dd379c7180ed786380 HTTP/1.1" 200 None 2026-05-10 16:50:40,894 - lava_callback - INFO - Completed processing callback for node 6a00b6dd379c7180ed786380 2026-05-10 16:50:41,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:41,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70e379c7180ed78643f/lava-logs.yaml 2026-05-10 16:50:41,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:41,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:41,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:41,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b71d379c7180ed78648d HTTP/1.1" 200 None 2026-05-10 16:50:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:41,202 - lava_callback - DEBUG - Processing node 6a00b71d379c7180ed78648d: baseline-arm64-kontron 2026-05-10 16:50:41,359 - lava_callback - INFO - Received callback for node 6a00b6f6379c7180ed786401 INFO: 172.21.0.1:46122 - "POST /node/6a00b6f6379c7180ed786401 HTTP/1.0" 202 Accepted 2026-05-10 16:50:41,424 - lava_callback - INFO - Starting async job submit for node 6a00b6f6379c7180ed786401 2026-05-10 16:50:41,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b71e379c7180ed786490 HTTP/1.1" 200 None 2026-05-10 16:50:41,562 - lava_callback - INFO - Completed processing callback for node 6a00b71e379c7180ed786490 2026-05-10 16:50:41,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:41,717 - lava_callback - INFO - Received callback for node 6a00b6f1379c7180ed7863c9 INFO: 172.21.0.1:46138 - "POST /node/6a00b6f1379c7180ed7863c9 HTTP/1.0" 202 Accepted 2026-05-10 16:50:41,795 - lava_callback - INFO - Starting async job submit for node 6a00b6f1379c7180ed7863c9 2026-05-10 16:50:41,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f6379c7180ed786401 HTTP/1.1" 200 None 2026-05-10 16:50:41,913 - lava_callback - DEBUG - Processing node 6a00b6f6379c7180ed786401: baseline-nfs-arm64 2026-05-10 16:50:41,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:41,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70e379c7180ed78643f/lava_callback.json.gz 2026-05-10 16:50:42,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:42,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:42,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:42,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:42,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f1379c7180ed7863c9 HTTP/1.1" 200 None 2026-05-10 16:50:42,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f3379c7180ed7863cf/lava-logs.yaml 2026-05-10 16:50:42,297 - lava_callback - DEBUG - Processing node 6a00b6f1379c7180ed7863c9: baseline-nfs-arm64 2026-05-10 16:50:42,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:42,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b70e379c7180ed78643f HTTP/1.1" 200 None 2026-05-10 16:50:42,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:42,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:42,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:42,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:42,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b70e379c7180ed78643f HTTP/1.1" 200 None 2026-05-10 16:50:42,821 - lava_callback - INFO - Completed processing callback for node 6a00b70e379c7180ed78643f 2026-05-10 16:50:42,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:42,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f4379c7180ed7863d3/log.txt.gz 2026-05-10 16:50:43,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:43,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:43,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f3379c7180ed7863cf/lava_callback.json.gz 2026-05-10 16:50:43,378 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b71f379c7180ed786493/log.txt.gz 2026-05-10 16:50:43,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:43,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f3379c7180ed7863cf HTTP/1.1" 200 None 2026-05-10 16:50:44,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:44,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:44,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:44,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:44,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6f3379c7180ed7863cf HTTP/1.1" 200 None 2026-05-10 16:50:44,590 - lava_callback - INFO - Completed processing callback for node 6a00b6f3379c7180ed7863cf 2026-05-10 16:50:44,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:44,713 - lava_callback - INFO - Received callback for node 6a00b6e6379c7180ed78639e INFO: 172.21.0.1:46144 - "POST /node/6a00b6e6379c7180ed78639e HTTP/1.0" 202 Accepted 2026-05-10 16:50:44,786 - lava_callback - INFO - Starting async job submit for node 6a00b6e6379c7180ed78639e 2026-05-10 16:50:44,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:44,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-6a00b71d379c7180ed78648d/log.txt.gz 2026-05-10 16:50:45,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:45,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e6379c7180ed78639e HTTP/1.1" 200 None 2026-05-10 16:50:45,354 - lava_callback - DEBUG - Processing node 6a00b6e6379c7180ed78639e: baseline-arm64 2026-05-10 16:50:45,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:45,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:45,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:45,620 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b71f379c7180ed786493/lava-logs.yaml 2026-05-10 16:50:45,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:46,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:46,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f6379c7180ed786401/log.txt.gz 2026-05-10 16:50:46,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:46,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f1379c7180ed7863c9/log.txt.gz 2026-05-10 16:50:46,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:46,351 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b71f379c7180ed786493/lava_callback.json.gz INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:50:46,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:46,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b71f379c7180ed786493 HTTP/1.1" 200 None 2026-05-10 16:50:46,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:46,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:47,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:47,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:47,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:47,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b71f379c7180ed786493 HTTP/1.1" 200 None 2026-05-10 16:50:47,349 - lava_callback - INFO - Completed processing callback for node 6a00b71f379c7180ed786493 2026-05-10 16:50:47,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:47,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:47,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:47,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-6a00b71d379c7180ed78648d/lava-logs.yaml 2026-05-10 16:50:48,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:48,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:48,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:48,324 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f4379c7180ed7863d3/lava-logs.yaml 2026-05-10 16:50:48,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:48,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:48,472 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f1379c7180ed7863c9/lava-logs.yaml 2026-05-10 16:50:48,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:48,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:48,497 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f6379c7180ed786401/lava-logs.yaml 2026-05-10 16:50:48,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:48,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-6a00b71d379c7180ed78648d/lava_callback.json.gz 2026-05-10 16:50:48,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:48,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:48,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b71d379c7180ed78648d HTTP/1.1" 200 None 2026-05-10 16:50:48,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:48,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:48,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:48,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b71d379c7180ed78648d HTTP/1.1" 200 None 2026-05-10 16:50:48,669 - lava_callback - INFO - Completed processing callback for node 6a00b71d379c7180ed78648d 2026-05-10 16:50:48,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:48,774 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e6379c7180ed78639e/log.txt.gz 2026-05-10 16:50:48,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:48,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 16:50:49,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:49,012 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f4379c7180ed7863d3/lava_callback.json.gz 2026-05-10 16:50:49,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:49,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:49,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f1379c7180ed7863c9/lava_callback.json.gz 2026-05-10 16:50:49,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f6379c7180ed786401/lava_callback.json.gz 2026-05-10 16:50:49,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f4379c7180ed7863d3 HTTP/1.1" 200 None 2026-05-10 16:50:49,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f6379c7180ed786401 HTTP/1.1" 200 None 2026-05-10 16:50:49,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f1379c7180ed7863c9 HTTP/1.1" 200 None 2026-05-10 16:50:49,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:49,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:49,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:49,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:49,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6f4379c7180ed7863d3 HTTP/1.1" 200 None 2026-05-10 16:50:49,466 - lava_callback - INFO - Completed processing callback for node 6a00b6f4379c7180ed7863d3 2026-05-10 16:50:49,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6f1379c7180ed7863c9 HTTP/1.1" 200 None 2026-05-10 16:50:49,562 - lava_callback - INFO - Completed processing callback for node 6a00b6f1379c7180ed7863c9 2026-05-10 16:50:49,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6f6379c7180ed786401 HTTP/1.1" 200 None 2026-05-10 16:50:49,577 - lava_callback - INFO - Completed processing callback for node 6a00b6f6379c7180ed786401 2026-05-10 16:50:49,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:50,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:50,465 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e6379c7180ed78639e/lava-logs.yaml 2026-05-10 16:50:50,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:50,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:50,925 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6e6379c7180ed78639e/lava_callback.json.gz 2026-05-10 16:50:51,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:51,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6e6379c7180ed78639e HTTP/1.1" 200 None 2026-05-10 16:50:51,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:51,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:51,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:51,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6e6379c7180ed78639e HTTP/1.1" 200 None 2026-05-10 16:50:51,212 - lava_callback - INFO - Completed processing callback for node 6a00b6e6379c7180ed78639e 2026-05-10 16:50:51,665 - lava_callback - INFO - Received callback for node 6a00b6ee379c7180ed7863b7 INFO: 172.21.0.1:59906 - "POST /node/6a00b6ee379c7180ed7863b7 HTTP/1.0" 202 Accepted 2026-05-10 16:50:51,676 - lava_callback - INFO - Starting async job submit for node 6a00b6ee379c7180ed7863b7 2026-05-10 16:50:51,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:51,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6ee379c7180ed7863b7 HTTP/1.1" 200 None 2026-05-10 16:50:51,756 - lava_callback - DEBUG - Processing node 6a00b6ee379c7180ed7863b7: baseline-nfs-arm64 2026-05-10 16:50:51,960 - lava_callback - INFO - Received callback for node 6a00b720379c7180ed786497 INFO: 172.21.0.1:59916 - "POST /node/6a00b720379c7180ed786497 HTTP/1.0" 202 Accepted 2026-05-10 16:50:51,991 - lava_callback - INFO - Starting async job submit for node 6a00b720379c7180ed786497 2026-05-10 16:50:52,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:52,108 - lava_callback - INFO - Received callback for node 6a00b707379c7180ed786429 INFO: 172.21.0.1:59930 - "POST /node/6a00b707379c7180ed786429 HTTP/1.0" 202 Accepted 2026-05-10 16:50:52,139 - lava_callback - INFO - Starting async job submit for node 6a00b707379c7180ed786429 2026-05-10 16:50:52,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b720379c7180ed786497 HTTP/1.1" 200 None 2026-05-10 16:50:52,221 - lava_callback - DEBUG - Processing node 6a00b720379c7180ed786497: baseline-arm64-pengutronix 2026-05-10 16:50:52,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:52,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b707379c7180ed786429 HTTP/1.1" 200 None 2026-05-10 16:50:52,368 - lava_callback - DEBUG - Processing node 6a00b707379c7180ed786429: baseline-arm64-broonie 2026-05-10 16:50:52,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:53,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:53,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:53,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6ee379c7180ed7863b7/log.txt.gz 2026-05-10 16:50:53,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:53,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:53,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b720379c7180ed786497/log.txt.gz 2026-05-10 16:50:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:53,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:53,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b707379c7180ed786429/log.txt.gz 2026-05-10 16:50:54,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:54,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:54,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:54,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6ee379c7180ed7863b7/lava-logs.yaml 2026-05-10 16:50:54,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:54,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:54,754 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b720379c7180ed786497/lava-logs.yaml 2026-05-10 16:50:54,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:54,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:54,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b707379c7180ed786429/lava-logs.yaml 2026-05-10 16:50:54,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:50:54,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:54,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6ee379c7180ed7863b7/lava_callback.json.gz 2026-05-10 16:50:55,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6ee379c7180ed7863b7 HTTP/1.1" 200 None 2026-05-10 16:50:55,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:55,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:55,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b707379c7180ed786429/lava_callback.json.gz 2026-05-10 16:50:55,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6ee379c7180ed7863b7 HTTP/1.1" 200 None 2026-05-10 16:50:55,145 - lava_callback - INFO - Completed processing callback for node 6a00b6ee379c7180ed7863b7 2026-05-10 16:50:55,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:50:55,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a00b720379c7180ed786497/lava_callback.json.gz 2026-05-10 16:50:55,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b707379c7180ed786429 HTTP/1.1" 200 None 2026-05-10 16:50:55,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:55,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b720379c7180ed786497 HTTP/1.1" 200 None 2026-05-10 16:50:55,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:50:55,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:50:55,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b707379c7180ed786429 HTTP/1.1" 200 None 2026-05-10 16:50:55,391 - lava_callback - INFO - Completed processing callback for node 6a00b707379c7180ed786429 2026-05-10 16:50:55,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b720379c7180ed786497 HTTP/1.1" 200 None 2026-05-10 16:50:55,487 - lava_callback - INFO - Completed processing callback for node 6a00b720379c7180ed786497 INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 16:51:15,430 - lava_callback - INFO - Received callback for node 6a00b70a379c7180ed786432 INFO: 172.21.0.1:40486 - "POST /node/6a00b70a379c7180ed786432 HTTP/1.0" 202 Accepted 2026-05-10 16:51:15,442 - lava_callback - INFO - Starting async job submit for node 6a00b70a379c7180ed786432 2026-05-10 16:51:15,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:15,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b70a379c7180ed786432 HTTP/1.1" 200 None 2026-05-10 16:51:15,521 - lava_callback - DEBUG - Processing node 6a00b70a379c7180ed786432: baseline-arm64-broonie 2026-05-10 16:51:16,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:16,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:16,203 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70a379c7180ed786432/log.txt.gz 2026-05-10 16:51:16,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:51:16,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:16,836 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70a379c7180ed786432/lava-logs.yaml 2026-05-10 16:51:16,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:16,978 - lava_callback - INFO - Received callback for node 6a00b70b379c7180ed786439 INFO: 172.21.0.1:40506 - "POST /node/6a00b70b379c7180ed786439 HTTP/1.0" 202 Accepted 2026-05-10 16:51:16,989 - lava_callback - INFO - Starting async job submit for node 6a00b70b379c7180ed786439 2026-05-10 16:51:17,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:17,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b70b379c7180ed786439 HTTP/1.1" 200 None 2026-05-10 16:51:17,062 - lava_callback - DEBUG - Processing node 6a00b70b379c7180ed786439: baseline-arm64-broonie 2026-05-10 16:51:17,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:17,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70a379c7180ed786432/lava_callback.json.gz 2026-05-10 16:51:17,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:17,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b70a379c7180ed786432 HTTP/1.1" 200 None 2026-05-10 16:51:17,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:17,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:51:17,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:17,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b70a379c7180ed786432 HTTP/1.1" 200 None 2026-05-10 16:51:17,477 - lava_callback - INFO - Completed processing callback for node 6a00b70a379c7180ed786432 2026-05-10 16:51:17,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:17,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:17,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70b379c7180ed786439/log.txt.gz 2026-05-10 16:51:18,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:18,456 - lava_callback - INFO - Received callback for node 6a00b712379c7180ed78644e INFO: 172.21.0.1:40510 - "POST /node/6a00b712379c7180ed78644e HTTP/1.0" 202 Accepted 2026-05-10 16:51:18,468 - lava_callback - INFO - Starting async job submit for node 6a00b712379c7180ed78644e 2026-05-10 16:51:18,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:18,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b712379c7180ed78644e HTTP/1.1" 200 None 2026-05-10 16:51:18,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:18,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70b379c7180ed786439/lava-logs.yaml 2026-05-10 16:51:18,561 - lava_callback - DEBUG - Processing node 6a00b712379c7180ed78644e: baseline-arm64-broonie 2026-05-10 16:51:18,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:19,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:19,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:19,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70b379c7180ed786439/lava_callback.json.gz 2026-05-10 16:51:19,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 16:51:19,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:19,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:19,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b70b379c7180ed786439 HTTP/1.1" 200 None 2026-05-10 16:51:19,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:19,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:51:19,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:19,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b70b379c7180ed786439 HTTP/1.1" 200 None 2026-05-10 16:51:19,263 - lava_callback - INFO - Completed processing callback for node 6a00b70b379c7180ed786439 2026-05-10 16:51:19,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:19,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b712379c7180ed78644e/log.txt.gz 2026-05-10 16:51:19,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:20,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:20,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b712379c7180ed78644e/lava-logs.yaml 2026-05-10 16:51:20,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:20,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:20,226 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b712379c7180ed78644e/lava_callback.json.gz 2026-05-10 16:51:20,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:20,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b712379c7180ed78644e HTTP/1.1" 200 None 2026-05-10 16:51:20,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:20,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:51:20,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:20,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b712379c7180ed78644e HTTP/1.1" 200 None 2026-05-10 16:51:20,369 - lava_callback - INFO - Completed processing callback for node 6a00b712379c7180ed78644e INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:51:32,130 - lava_callback - INFO - Received callback for node 6a00b713379c7180ed786451 INFO: 172.21.0.1:55472 - "POST /node/6a00b713379c7180ed786451 HTTP/1.0" 202 Accepted 2026-05-10 16:51:32,140 - lava_callback - INFO - Starting async job submit for node 6a00b713379c7180ed786451 2026-05-10 16:51:32,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:32,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b713379c7180ed786451 HTTP/1.1" 200 None 2026-05-10 16:51:32,205 - lava_callback - DEBUG - Processing node 6a00b713379c7180ed786451: baseline-arm64-broonie 2026-05-10 16:51:32,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:32,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:32,726 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b713379c7180ed786451/log.txt.gz 2026-05-10 16:51:32,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:33,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:33,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b713379c7180ed786451/lava-logs.yaml 2026-05-10 16:51:33,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:33,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:33,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b713379c7180ed786451/lava_callback.json.gz 2026-05-10 16:51:33,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:33,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b713379c7180ed786451 HTTP/1.1" 200 None 2026-05-10 16:51:33,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:33,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:51:33,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:33,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b713379c7180ed786451 HTTP/1.1" 200 None 2026-05-10 16:51:33,335 - lava_callback - INFO - Completed processing callback for node 6a00b713379c7180ed786451 2026-05-10 16:51:35,465 - lava_callback - INFO - Received callback for node 6a00b710379c7180ed78644b INFO: 172.21.0.1:55486 - "POST /node/6a00b710379c7180ed78644b HTTP/1.0" 202 Accepted 2026-05-10 16:51:35,472 - lava_callback - INFO - Starting async job submit for node 6a00b710379c7180ed78644b 2026-05-10 16:51:35,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:35,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b710379c7180ed78644b HTTP/1.1" 200 None 2026-05-10 16:51:35,550 - lava_callback - DEBUG - Processing node 6a00b710379c7180ed78644b: baseline-arm64-broonie INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:51:35,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:36,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:36,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b710379c7180ed78644b/log.txt.gz 2026-05-10 16:51:36,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:36,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:36,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b710379c7180ed78644b/lava-logs.yaml 2026-05-10 16:51:36,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:51:36,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:36,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b710379c7180ed78644b/lava_callback.json.gz 2026-05-10 16:51:36,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:36,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b710379c7180ed78644b HTTP/1.1" 200 None 2026-05-10 16:51:36,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:36,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:51:36,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:36,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b710379c7180ed78644b HTTP/1.1" 200 None 2026-05-10 16:51:36,762 - lava_callback - INFO - Completed processing callback for node 6a00b710379c7180ed78644b INFO: 172.21.0.1:38854 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:51:49,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:49,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 16:51:49,205 - lava_callback - INFO - Received callback for node 69fe149de4d4e78cd76b0a90 INFO: 172.21.0.1:38862 - "POST /node/69fe149de4d4e78cd76b0a90 HTTP/1.0" 202 Accepted 2026-05-10 16:51:49,210 - lava_callback - INFO - Starting async job submit for node 69fe149de4d4e78cd76b0a90 2026-05-10 16:51:49,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:49,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe149de4d4e78cd76b0a90 HTTP/1.1" 200 None 2026-05-10 16:51:49,227 - lava_callback - DEBUG - Processing node 69fe149de4d4e78cd76b0a90: baseline-arm64-baylibre 2026-05-10 16:51:49,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe149de4d4e78cd76b0a90 2026-05-10 16:51:49,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:49,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe149de4d4e78cd76b0a90 HTTP/1.1" 200 None 2026-05-10 16:51:49,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:49,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:51:49,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:49,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe149de4d4e78cd76b0a90 HTTP/1.1" 200 None 2026-05-10 16:51:49,276 - lava_callback - ERROR - Error processing callback for node 69fe149de4d4e78cd76b0a90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 16:51:52,074 - lava_callback - INFO - Received callback for node 6a00b708379c7180ed78642f INFO: 172.21.0.1:36740 - "POST /node/6a00b708379c7180ed78642f HTTP/1.0" 202 Accepted 2026-05-10 16:51:52,080 - lava_callback - INFO - Starting async job submit for node 6a00b708379c7180ed78642f 2026-05-10 16:51:52,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:52,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b708379c7180ed78642f HTTP/1.1" 200 None 2026-05-10 16:51:52,132 - lava_callback - DEBUG - Processing node 6a00b708379c7180ed78642f: baseline-arm64-broonie 2026-05-10 16:51:52,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:52,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:52,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b708379c7180ed78642f/log.txt.gz 2026-05-10 16:51:52,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:52,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:52,826 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b708379c7180ed78642f/lava-logs.yaml 2026-05-10 16:51:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:51:52,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:51:52,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b708379c7180ed78642f/lava_callback.json.gz 2026-05-10 16:51:52,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:52,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b708379c7180ed78642f HTTP/1.1" 200 None 2026-05-10 16:51:52,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:53,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:51:53,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:51:53,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b708379c7180ed78642f HTTP/1.1" 200 None 2026-05-10 16:51:53,027 - lava_callback - INFO - Completed processing callback for node 6a00b708379c7180ed78642f INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:52:01,850 - lava_callback - INFO - Received callback for node 6a00b719379c7180ed786482 INFO: 172.21.0.1:57128 - "POST /node/6a00b719379c7180ed786482 HTTP/1.0" 202 Accepted 2026-05-10 16:52:01,862 - lava_callback - INFO - Starting async job submit for node 6a00b719379c7180ed786482 2026-05-10 16:52:01,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:01,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b719379c7180ed786482 HTTP/1.1" 200 None 2026-05-10 16:52:01,954 - lava_callback - DEBUG - Processing node 6a00b719379c7180ed786482: baseline-arm64-clabbe 2026-05-10 16:52:02,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:52:02,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:52:02,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-6a00b719379c7180ed786482/log.txt.gz 2026-05-10 16:52:02,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:52:02,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:52:02,762 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-6a00b719379c7180ed786482/lava-logs.yaml 2026-05-10 16:52:02,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:52:02,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:52:02,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-6a00b719379c7180ed786482/lava_callback.json.gz 2026-05-10 16:52:02,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:02,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b719379c7180ed786482 HTTP/1.1" 200 None 2026-05-10 16:52:02,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:02,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:52:02,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:02,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b719379c7180ed786482 HTTP/1.1" 200 None 2026-05-10 16:52:02,958 - lava_callback - INFO - Completed processing callback for node 6a00b719379c7180ed786482 INFO: 172.21.0.1:57136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:52:19,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:19,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:52:52,194 - lava_callback - INFO - Received callback for node 6a00b70d379c7180ed78643c INFO: 172.21.0.1:51530 - "POST /node/6a00b70d379c7180ed78643c HTTP/1.0" 202 Accepted 2026-05-10 16:52:52,205 - lava_callback - INFO - Starting async job submit for node 6a00b70d379c7180ed78643c 2026-05-10 16:52:52,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:52,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b70d379c7180ed78643c HTTP/1.1" 200 None 2026-05-10 16:52:52,249 - lava_callback - DEBUG - Processing node 6a00b70d379c7180ed78643c: baseline-arm64-broonie 2026-05-10 16:52:52,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:52:52,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:52:52,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70d379c7180ed78643c/log.txt.gz 2026-05-10 16:52:52,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:52:52,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:52:52,929 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70d379c7180ed78643c/lava-logs.yaml 2026-05-10 16:52:52,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:52:53,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:52:53,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a00b70d379c7180ed78643c/lava_callback.json.gz 2026-05-10 16:52:53,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:53,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b70d379c7180ed78643c HTTP/1.1" 200 None 2026-05-10 16:52:53,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:53,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:52:53,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:52:53,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b70d379c7180ed78643c HTTP/1.1" 200 None 2026-05-10 16:52:53,101 - lava_callback - INFO - Completed processing callback for node 6a00b70d379c7180ed78643c INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:53:19,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:19,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54760 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:53:29,948 - lava_callback - INFO - Received callback for node 69fe14f8e4d4e78cd76b0ad3 INFO: 172.21.0.1:38228 - "POST /node/69fe14f8e4d4e78cd76b0ad3 HTTP/1.0" 202 Accepted 2026-05-10 16:53:29,954 - lava_callback - INFO - Starting async job submit for node 69fe14f8e4d4e78cd76b0ad3 2026-05-10 16:53:29,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:29,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe14f8e4d4e78cd76b0ad3 HTTP/1.1" 200 None 2026-05-10 16:53:29,975 - lava_callback - DEBUG - Processing node 69fe14f8e4d4e78cd76b0ad3: baseline-arm64-clabbe 2026-05-10 16:53:29,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe14f8e4d4e78cd76b0ad3 2026-05-10 16:53:29,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:29,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe14f8e4d4e78cd76b0ad3 HTTP/1.1" 200 None 2026-05-10 16:53:29,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:30,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:53:30,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:30,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe14f8e4d4e78cd76b0ad3 HTTP/1.1" 200 None 2026-05-10 16:53:30,044 - lava_callback - ERROR - Error processing callback for node 69fe14f8e4d4e78cd76b0ad3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38738 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:53:55,529 - lava_callback - INFO - Received callback for node 6a00b63d379c7180ed78624e INFO: 172.21.0.1:52722 - "POST /node/6a00b63d379c7180ed78624e HTTP/1.0" 202 Accepted 2026-05-10 16:53:55,540 - lava_callback - INFO - Starting async job submit for node 6a00b63d379c7180ed78624e 2026-05-10 16:53:55,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:55,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b63d379c7180ed78624e HTTP/1.1" 200 None 2026-05-10 16:53:55,609 - lava_callback - DEBUG - Processing node 6a00b63d379c7180ed78624e: baseline-arm-broonie 2026-05-10 16:53:55,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:53:56,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:53:56,113 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63d379c7180ed78624e/log.txt.gz 2026-05-10 16:53:56,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:53:56,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:53:56,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63d379c7180ed78624e/lava-logs.yaml 2026-05-10 16:53:56,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:53:56,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:53:56,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a00b63d379c7180ed78624e/lava_callback.json.gz 2026-05-10 16:53:56,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:56,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b63d379c7180ed78624e HTTP/1.1" 200 None 2026-05-10 16:53:56,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:56,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:53:56,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:53:56,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b63d379c7180ed78624e HTTP/1.1" 200 None 2026-05-10 16:53:56,817 - lava_callback - INFO - Completed processing callback for node 6a00b63d379c7180ed78624e INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48730 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:54:19,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:19,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:54:30,051 - lava_callback - INFO - Received callback for node 6a00b722379c7180ed78649d INFO: 172.21.0.1:36090 - "POST /node/6a00b722379c7180ed78649d HTTP/1.0" 202 Accepted 2026-05-10 16:54:30,063 - lava_callback - INFO - Starting async job submit for node 6a00b722379c7180ed78649d 2026-05-10 16:54:30,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:30,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b722379c7180ed78649d HTTP/1.1" 200 None 2026-05-10 16:54:30,160 - lava_callback - DEBUG - Processing node 6a00b722379c7180ed78649d: baseline-arm64-foundriesio 2026-05-10 16:54:31,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:54:31,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:54:31,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00b722379c7180ed78649d/log.txt.gz 2026-05-10 16:54:32,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:54:32,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:54:32,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00b722379c7180ed78649d/lava-logs.yaml 2026-05-10 16:54:32,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:54:33,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:54:33,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00b722379c7180ed78649d/lava_callback.json.gz DEBUG: 6a00b722379c7180ed78649d Transitting job node result: pass -> incomplete 2026-05-10 16:54:33,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:33,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b722379c7180ed78649d HTTP/1.1" 200 None 2026-05-10 16:54:33,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:33,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:54:33,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:33,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b722379c7180ed78649d HTTP/1.1" 200 None 2026-05-10 16:54:33,120 - lava_callback - INFO - Completed processing callback for node 6a00b722379c7180ed78649d INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:54:49,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:49,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 16:54:49,980 - lava_callback - INFO - Received callback for node 69fe154ce4d4e78cd76b0aee INFO: 172.21.0.1:54062 - "POST /node/69fe154ce4d4e78cd76b0aee HTTP/1.0" 202 Accepted 2026-05-10 16:54:49,989 - lava_callback - INFO - Starting async job submit for node 69fe154ce4d4e78cd76b0aee 2026-05-10 16:54:49,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:50,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe154ce4d4e78cd76b0aee HTTP/1.1" 200 None 2026-05-10 16:54:50,011 - lava_callback - DEBUG - Processing node 69fe154ce4d4e78cd76b0aee: baseline-arm64-clabbe 2026-05-10 16:54:50,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe154ce4d4e78cd76b0aee 2026-05-10 16:54:50,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:50,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe154ce4d4e78cd76b0aee HTTP/1.1" 200 None 2026-05-10 16:54:50,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:50,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:54:50,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:54:50,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe154ce4d4e78cd76b0aee HTTP/1.1" 200 None 2026-05-10 16:54:50,061 - lava_callback - ERROR - Error processing callback for node 69fe154ce4d4e78cd76b0aee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:56:35,869 - lava_callback - INFO - Received callback for node 6a00b8b4379c7180ed786679 INFO: 172.21.0.1:39104 - "POST /node/6a00b8b4379c7180ed786679 HTTP/1.0" 202 Accepted 2026-05-10 16:56:35,875 - lava_callback - INFO - Starting async job submit for node 6a00b8b4379c7180ed786679 2026-05-10 16:56:35,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:35,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b8b4379c7180ed786679 HTTP/1.1" 200 None 2026-05-10 16:56:35,893 - lava_callback - DEBUG - Processing node 6a00b8b4379c7180ed786679: baseline-nfs-arm64 2026-05-10 16:56:35,894 - lava_callback - WARNING - Failed to upload log 2026-05-10 16:56:35,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:56:35,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:56:35,985 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b8b4379c7180ed786679/lava-logs.yaml 2026-05-10 16:56:35,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:56:36,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:56:36,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b8b4379c7180ed786679/lava_callback.json.gz 2026-05-10 16:56:36,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:36,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b8b4379c7180ed786679 HTTP/1.1" 200 None 2026-05-10 16:56:36,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:36,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:56:36,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:36,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b8b4379c7180ed786679 HTTP/1.1" 200 None 2026-05-10 16:56:36,144 - lava_callback - INFO - Completed processing callback for node 6a00b8b4379c7180ed786679 INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:56:39,774 - lava_callback - INFO - Received callback for node 6a00b6ed379c7180ed7863b4 INFO: 172.21.0.1:43092 - "POST /node/6a00b6ed379c7180ed7863b4 HTTP/1.0" 202 Accepted 2026-05-10 16:56:39,781 - lava_callback - INFO - Starting async job submit for node 6a00b6ed379c7180ed7863b4 2026-05-10 16:56:39,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:39,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6ed379c7180ed7863b4 HTTP/1.1" 200 None 2026-05-10 16:56:39,839 - lava_callback - DEBUG - Processing node 6a00b6ed379c7180ed7863b4: baseline-arm64 2026-05-10 16:56:40,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:56:40,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:56:40,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6ed379c7180ed7863b4/log.txt.gz 2026-05-10 16:56:40,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:56:40,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:56:40,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6ed379c7180ed7863b4/lava-logs.yaml 2026-05-10 16:56:40,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:56:40,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:56:40,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b6ed379c7180ed7863b4/lava_callback.json.gz DEBUG: Setup failed for 6a00b6ed379c7180ed7863b4. Transitting job node result: incomplete -> fail 2026-05-10 16:56:40,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:40,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6ed379c7180ed7863b4 HTTP/1.1" 200 None 2026-05-10 16:56:40,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:40,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:56:40,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:40,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6ed379c7180ed7863b4 HTTP/1.1" 200 None 2026-05-10 16:56:40,997 - lava_callback - INFO - Completed processing callback for node 6a00b6ed379c7180ed7863b4 INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:56:49,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:56:49,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:57:09,701 - lava_callback - INFO - Received callback for node 69fe15dae4d4e78cd76b0b40 INFO: 172.21.0.1:49822 - "POST /node/69fe15dae4d4e78cd76b0b40 HTTP/1.0" 202 Accepted 2026-05-10 16:57:09,710 - lava_callback - INFO - Starting async job submit for node 69fe15dae4d4e78cd76b0b40 2026-05-10 16:57:09,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:09,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe15dae4d4e78cd76b0b40 HTTP/1.1" 200 None 2026-05-10 16:57:09,728 - lava_callback - DEBUG - Processing node 69fe15dae4d4e78cd76b0b40: baseline-arm64-baylibre 2026-05-10 16:57:09,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe15dae4d4e78cd76b0b40 2026-05-10 16:57:09,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:09,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe15dae4d4e78cd76b0b40 HTTP/1.1" 200 None 2026-05-10 16:57:09,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:09,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:57:09,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:09,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe15dae4d4e78cd76b0b40 HTTP/1.1" 200 None 2026-05-10 16:57:09,787 - lava_callback - ERROR - Error processing callback for node 69fe15dae4d4e78cd76b0b40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:57:17,401 - lava_callback - INFO - Received callback for node 6a00b677379c7180ed7862fe INFO: 172.21.0.1:49846 - "POST /node/6a00b677379c7180ed7862fe HTTP/1.0" 202 Accepted 2026-05-10 16:57:17,408 - lava_callback - INFO - Starting async job submit for node 6a00b677379c7180ed7862fe 2026-05-10 16:57:17,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:17,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b677379c7180ed7862fe HTTP/1.1" 200 None 2026-05-10 16:57:17,447 - lava_callback - DEBUG - Processing node 6a00b677379c7180ed7862fe: ltp-syscalls 2026-05-10 16:57:18,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:57:18,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:57:18,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-6a00b677379c7180ed7862fe/log.txt.gz 2026-05-10 16:57:18,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:57:19,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:57:19,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-6a00b677379c7180ed7862fe/lava-logs.yaml 2026-05-10 16:57:19,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:57:19,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:57:19,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-6a00b677379c7180ed7862fe/lava_callback.json.gz 2026-05-10 16:57:19,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:19,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b677379c7180ed7862fe HTTP/1.1" 200 None 2026-05-10 16:57:19,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:19,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:57:19,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:19,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b677379c7180ed7862fe HTTP/1.1" 200 None 2026-05-10 16:57:19,305 - lava_callback - INFO - Completed processing callback for node 6a00b677379c7180ed7862fe INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:57:40,865 - lava_callback - INFO - Received callback for node 6a00b8f5379c7180ed7866b0 INFO: 172.21.0.1:46550 - "POST /node/6a00b8f5379c7180ed7866b0 HTTP/1.0" 202 Accepted 2026-05-10 16:57:40,871 - lava_callback - INFO - Starting async job submit for node 6a00b8f5379c7180ed7866b0 2026-05-10 16:57:40,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:40,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b8f5379c7180ed7866b0 HTTP/1.1" 200 None 2026-05-10 16:57:40,892 - lava_callback - DEBUG - Processing node 6a00b8f5379c7180ed7866b0: baseline-arm 2026-05-10 16:57:40,897 - lava_callback - WARNING - Failed to upload log 2026-05-10 16:57:40,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:57:41,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:57:41,007 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b8f5379c7180ed7866b0/lava-logs.yaml 2026-05-10 16:57:41,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:57:41,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:57:41,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b8f5379c7180ed7866b0/lava_callback.json.gz 2026-05-10 16:57:41,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:41,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b8f5379c7180ed7866b0 HTTP/1.1" 200 None 2026-05-10 16:57:41,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:41,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 16:57:41,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:41,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b8f5379c7180ed7866b0 HTTP/1.1" 200 None 2026-05-10 16:57:41,157 - lava_callback - INFO - Completed processing callback for node 6a00b8f5379c7180ed7866b0 INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:57:49,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:57:49,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:58:30,164 - lava_callback - INFO - Received callback for node 69fe1632e4d4e78cd76b0b6b INFO: 172.21.0.1:57728 - "POST /node/69fe1632e4d4e78cd76b0b6b HTTP/1.0" 202 Accepted 2026-05-10 16:58:30,169 - lava_callback - INFO - Starting async job submit for node 69fe1632e4d4e78cd76b0b6b 2026-05-10 16:58:30,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:58:30,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1632e4d4e78cd76b0b6b HTTP/1.1" 200 None 2026-05-10 16:58:30,184 - lava_callback - DEBUG - Processing node 69fe1632e4d4e78cd76b0b6b: baseline-arm64-clabbe 2026-05-10 16:58:30,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1632e4d4e78cd76b0b6b 2026-05-10 16:58:30,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:58:30,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1632e4d4e78cd76b0b6b HTTP/1.1" 200 None 2026-05-10 16:58:30,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:58:30,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 16:58:30,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:58:30,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1632e4d4e78cd76b0b6b HTTP/1.1" 200 None 2026-05-10 16:58:30,236 - lava_callback - ERROR - Error processing callback for node 69fe1632e4d4e78cd76b0b6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:59:05,368 - lava_callback - INFO - Received callback for node 6a00b91c379c7180ed7866c2 INFO: 172.21.0.1:53798 - "POST /node/6a00b91c379c7180ed7866c2 HTTP/1.0" 202 Accepted 2026-05-10 16:59:05,375 - lava_callback - INFO - Starting async job submit for node 6a00b91c379c7180ed7866c2 2026-05-10 16:59:05,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:59:05,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b91c379c7180ed7866c2 HTTP/1.1" 200 None 2026-05-10 16:59:05,434 - lava_callback - DEBUG - Processing node 6a00b91c379c7180ed7866c2: baseline-arm64 2026-05-10 16:59:05,617 - lava_callback - WARNING - Failed to upload log 2026-05-10 16:59:05,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:59:05,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:59:05,847 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b91c379c7180ed7866c2/lava-logs.yaml 2026-05-10 16:59:05,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 16:59:05,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 16:59:05,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b91c379c7180ed7866c2/lava_callback.json.gz 2026-05-10 16:59:05,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:59:05,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b91c379c7180ed7866c2 HTTP/1.1" 200 None 2026-05-10 16:59:05,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:59:06,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 16:59:06,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:59:06,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b91c379c7180ed7866c2 HTTP/1.1" 200 None 2026-05-10 16:59:06,126 - lava_callback - INFO - Completed processing callback for node 6a00b91c379c7180ed7866c2 INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK 2026-05-10 16:59:19,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 16:59:19,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:00:01,356 - lava_callback - INFO - Received callback for node 6a00b965379c7180ed7866e4 INFO: 172.21.0.1:46416 - "POST /node/6a00b965379c7180ed7866e4 HTTP/1.0" 202 Accepted 2026-05-10 17:00:01,366 - lava_callback - INFO - Starting async job submit for node 6a00b965379c7180ed7866e4 2026-05-10 17:00:01,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:01,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b965379c7180ed7866e4 HTTP/1.1" 200 None 2026-05-10 17:00:01,430 - lava_callback - DEBUG - Processing node 6a00b965379c7180ed7866e4: baseline-arm64 2026-05-10 17:00:01,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:00:01,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:00:01,692 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b965379c7180ed7866e4/log.txt.gz 2026-05-10 17:00:01,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:00:01,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:00:01,936 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b965379c7180ed7866e4/lava-logs.yaml 2026-05-10 17:00:01,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:00:02,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:00:02,024 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00b965379c7180ed7866e4/lava_callback.json.gz 2026-05-10 17:00:02,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:02,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b965379c7180ed7866e4 HTTP/1.1" 200 None 2026-05-10 17:00:02,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:02,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:00:02,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:02,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b965379c7180ed7866e4 HTTP/1.1" 200 None 2026-05-10 17:00:02,178 - lava_callback - INFO - Completed processing callback for node 6a00b965379c7180ed7866e4 INFO: 172.21.0.1:46418 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:00:10,422 - lava_callback - INFO - Received callback for node 69fe1688e4d4e78cd76b0b91 INFO: 172.21.0.1:44860 - "POST /node/69fe1688e4d4e78cd76b0b91 HTTP/1.0" 202 Accepted 2026-05-10 17:00:10,428 - lava_callback - INFO - Starting async job submit for node 69fe1688e4d4e78cd76b0b91 2026-05-10 17:00:10,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:10,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1688e4d4e78cd76b0b91 HTTP/1.1" 200 None 2026-05-10 17:00:10,445 - lava_callback - DEBUG - Processing node 69fe1688e4d4e78cd76b0b91: baseline-arm64-clabbe 2026-05-10 17:00:10,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1688e4d4e78cd76b0b91 2026-05-10 17:00:10,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:10,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1688e4d4e78cd76b0b91 HTTP/1.1" 200 None 2026-05-10 17:00:10,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:10,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:00:10,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:10,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1688e4d4e78cd76b0b91 HTTP/1.1" 200 None 2026-05-10 17:00:10,493 - lava_callback - ERROR - Error processing callback for node 69fe1688e4d4e78cd76b0b91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:00:19,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:00:19,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:01:30,256 - lava_callback - INFO - Received callback for node 69fe16dee4d4e78cd76b0bbe INFO: 172.21.0.1:59804 - "POST /node/69fe16dee4d4e78cd76b0bbe HTTP/1.0" 202 Accepted 2026-05-10 17:01:30,266 - lava_callback - INFO - Starting async job submit for node 69fe16dee4d4e78cd76b0bbe 2026-05-10 17:01:30,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:01:30,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe16dee4d4e78cd76b0bbe HTTP/1.1" 200 None 2026-05-10 17:01:30,291 - lava_callback - DEBUG - Processing node 69fe16dee4d4e78cd76b0bbe: baseline-arm64-clabbe 2026-05-10 17:01:30,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe16dee4d4e78cd76b0bbe 2026-05-10 17:01:30,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:01:30,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe16dee4d4e78cd76b0bbe HTTP/1.1" 200 None 2026-05-10 17:01:30,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:01:30,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:01:30,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:01:30,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe16dee4d4e78cd76b0bbe HTTP/1.1" 200 None 2026-05-10 17:01:30,369 - lava_callback - ERROR - Error processing callback for node 69fe16dee4d4e78cd76b0bbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:02:50,314 - lava_callback - INFO - Received callback for node 69fe1733e4d4e78cd76b0bec INFO: 172.21.0.1:56924 - "POST /node/69fe1733e4d4e78cd76b0bec HTTP/1.0" 202 Accepted 2026-05-10 17:02:50,320 - lava_callback - INFO - Starting async job submit for node 69fe1733e4d4e78cd76b0bec 2026-05-10 17:02:50,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:02:50,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1733e4d4e78cd76b0bec HTTP/1.1" 200 None 2026-05-10 17:02:50,335 - lava_callback - DEBUG - Processing node 69fe1733e4d4e78cd76b0bec: baseline-arm64-clabbe 2026-05-10 17:02:50,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1733e4d4e78cd76b0bec 2026-05-10 17:02:50,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:02:50,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1733e4d4e78cd76b0bec HTTP/1.1" 200 None 2026-05-10 17:02:50,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:02:50,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:02:50,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:02:50,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1733e4d4e78cd76b0bec HTTP/1.1" 200 None 2026-05-10 17:02:50,383 - lava_callback - ERROR - Error processing callback for node 69fe1733e4d4e78cd76b0bec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:02:59,943 - lava_callback - INFO - Received callback for node 6a00ba02379c7180ed786735 INFO: 172.21.0.1:51444 - "POST /node/6a00ba02379c7180ed786735 HTTP/1.0" 202 Accepted 2026-05-10 17:02:59,949 - lava_callback - INFO - Starting async job submit for node 6a00ba02379c7180ed786735 2026-05-10 17:02:59,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:02:59,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00ba02379c7180ed786735 HTTP/1.1" 200 None 2026-05-10 17:02:59,983 - lava_callback - DEBUG - Processing node 6a00ba02379c7180ed786735: baseline-arm64 2026-05-10 17:03:00,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:03:00,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:03:00,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00ba02379c7180ed786735/log.txt.gz 2026-05-10 17:03:00,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:03:01,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:03:01,044 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00ba02379c7180ed786735/lava-logs.yaml 2026-05-10 17:03:01,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:03:01,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:03:01,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00ba02379c7180ed786735/lava_callback.json.gz 2026-05-10 17:03:01,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:03:01,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00ba02379c7180ed786735 HTTP/1.1" 200 None 2026-05-10 17:03:01,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:03:01,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:03:01,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:03:01,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00ba02379c7180ed786735 HTTP/1.1" 200 None 2026-05-10 17:03:01,300 - lava_callback - INFO - Completed processing callback for node 6a00ba02379c7180ed786735 2026-05-10 17:03:05,902 - lava_callback - INFO - Received callback for node 6a00b62b379c7180ed78621e INFO: 172.21.0.1:51450 - "POST /node/6a00b62b379c7180ed78621e HTTP/1.0" 202 Accepted 2026-05-10 17:03:05,909 - lava_callback - INFO - Starting async job submit for node 6a00b62b379c7180ed78621e 2026-05-10 17:03:05,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:03:05,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62b379c7180ed78621e HTTP/1.1" 200 None 2026-05-10 17:03:05,982 - lava_callback - DEBUG - Processing node 6a00b62b379c7180ed78621e: baseline-arm INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:03:06,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:03:06,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:03:06,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62b379c7180ed78621e/log.txt.gz 2026-05-10 17:03:07,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:03:07,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:03:07,345 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62b379c7180ed78621e/lava-logs.yaml 2026-05-10 17:03:07,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:03:07,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:03:07,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00b62b379c7180ed78621e/lava_callback.json.gz DEBUG: Setup failed for 6a00b62b379c7180ed78621e. Transitting job node result: incomplete -> fail 2026-05-10 17:03:07,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:03:07,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b62b379c7180ed78621e HTTP/1.1" 200 None 2026-05-10 17:03:07,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:03:07,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:03:07,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:03:07,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b62b379c7180ed78621e HTTP/1.1" 200 None 2026-05-10 17:03:07,817 - lava_callback - INFO - Completed processing callback for node 6a00b62b379c7180ed78621e INFO: 172.21.0.1:56386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:03:19,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:03:19,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:04:30,387 - lava_callback - INFO - Received callback for node 69fe1788e4d4e78cd76b0c16 INFO: 172.21.0.1:49854 - "POST /node/69fe1788e4d4e78cd76b0c16 HTTP/1.0" 202 Accepted 2026-05-10 17:04:30,393 - lava_callback - INFO - Starting async job submit for node 69fe1788e4d4e78cd76b0c16 2026-05-10 17:04:30,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:04:30,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1788e4d4e78cd76b0c16 HTTP/1.1" 200 None 2026-05-10 17:04:30,409 - lava_callback - DEBUG - Processing node 69fe1788e4d4e78cd76b0c16: baseline-arm64-clabbe 2026-05-10 17:04:30,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1788e4d4e78cd76b0c16 2026-05-10 17:04:30,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:04:30,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1788e4d4e78cd76b0c16 HTTP/1.1" 200 None 2026-05-10 17:04:30,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:04:30,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:04:30,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:04:30,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1788e4d4e78cd76b0c16 HTTP/1.1" 200 None 2026-05-10 17:04:30,455 - lava_callback - ERROR - Error processing callback for node 69fe1788e4d4e78cd76b0c16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:05:50,665 - lava_callback - INFO - Received callback for node 69fe17dfe4d4e78cd76b0c44 INFO: 172.21.0.1:59382 - "POST /node/69fe17dfe4d4e78cd76b0c44 HTTP/1.0" 202 Accepted 2026-05-10 17:05:50,671 - lava_callback - INFO - Starting async job submit for node 69fe17dfe4d4e78cd76b0c44 2026-05-10 17:05:50,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:05:50,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe17dfe4d4e78cd76b0c44 HTTP/1.1" 200 None 2026-05-10 17:05:50,715 - lava_callback - DEBUG - Processing node 69fe17dfe4d4e78cd76b0c44: baseline-arm64-clabbe 2026-05-10 17:05:50,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe17dfe4d4e78cd76b0c44 2026-05-10 17:05:50,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:05:50,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe17dfe4d4e78cd76b0c44 HTTP/1.1" 200 None 2026-05-10 17:05:50,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:05:50,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:05:50,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:05:50,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe17dfe4d4e78cd76b0c44 HTTP/1.1" 200 None 2026-05-10 17:05:50,794 - lava_callback - ERROR - Error processing callback for node 69fe17dfe4d4e78cd76b0c44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:07:10,489 - lava_callback - INFO - Received callback for node 69fe1832e4d4e78cd76b0c73 INFO: 172.21.0.1:57228 - "POST /node/69fe1832e4d4e78cd76b0c73 HTTP/1.0" 202 Accepted 2026-05-10 17:07:10,495 - lava_callback - INFO - Starting async job submit for node 69fe1832e4d4e78cd76b0c73 2026-05-10 17:07:10,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:07:10,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1832e4d4e78cd76b0c73 HTTP/1.1" 200 None 2026-05-10 17:07:10,527 - lava_callback - DEBUG - Processing node 69fe1832e4d4e78cd76b0c73: baseline-arm64-clabbe 2026-05-10 17:07:10,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1832e4d4e78cd76b0c73 2026-05-10 17:07:10,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:07:10,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1832e4d4e78cd76b0c73 HTTP/1.1" 200 None 2026-05-10 17:07:10,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:07:10,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:07:10,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:07:10,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1832e4d4e78cd76b0c73 HTTP/1.1" 200 None 2026-05-10 17:07:10,580 - lava_callback - ERROR - Error processing callback for node 69fe1832e4d4e78cd76b0c73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41072 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 17:08:16,422 - lava_callback - INFO - Received callback for node 6a00b663379c7180ed7862d1 INFO: 172.21.0.1:41084 - "POST /node/6a00b663379c7180ed7862d1 HTTP/1.0" 202 Accepted 2026-05-10 17:08:16,437 - lava_callback - INFO - Starting async job submit for node 6a00b663379c7180ed7862d1 2026-05-10 17:08:16,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:16,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b663379c7180ed7862d1 HTTP/1.1" 200 None 2026-05-10 17:08:16,529 - lava_callback - DEBUG - Processing node 6a00b663379c7180ed7862d1: ltp-cap_bounds INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:08:17,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:08:17,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:08:17,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-6a00b663379c7180ed7862d1/log.txt.gz 2026-05-10 17:08:17,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:08:17,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:08:17,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-6a00b663379c7180ed7862d1/lava-logs.yaml 2026-05-10 17:08:17,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:08:18,052 - lava_callback - INFO - Received callback for node 6a00b664379c7180ed7862d4 INFO: 172.21.0.1:41098 - "POST /node/6a00b664379c7180ed7862d4 HTTP/1.0" 202 Accepted 2026-05-10 17:08:18,061 - lava_callback - INFO - Starting async job submit for node 6a00b664379c7180ed7862d4 2026-05-10 17:08:18,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:18,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b664379c7180ed7862d4 HTTP/1.1" 200 None 2026-05-10 17:08:18,111 - lava_callback - DEBUG - Processing node 6a00b664379c7180ed7862d4: ltp-containers 2026-05-10 17:08:18,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:08:18,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-6a00b663379c7180ed7862d1/lava_callback.json.gz 2026-05-10 17:08:18,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:18,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b663379c7180ed7862d1 HTTP/1.1" 200 None 2026-05-10 17:08:18,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:18,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:08:18,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:18,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b663379c7180ed7862d1 HTTP/1.1" 200 None 2026-05-10 17:08:18,519 - lava_callback - INFO - Completed processing callback for node 6a00b663379c7180ed7862d1 2026-05-10 17:08:18,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:08:18,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:08:18,995 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-6a00b664379c7180ed7862d4/log.txt.gz 2026-05-10 17:08:19,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:08:19,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:19,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 17:08:19,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:08:19,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-6a00b664379c7180ed7862d4/lava-logs.yaml 2026-05-10 17:08:19,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:08:19,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:08:19,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-6a00b664379c7180ed7862d4/lava_callback.json.gz 2026-05-10 17:08:19,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:19,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b664379c7180ed7862d4 HTTP/1.1" 200 None 2026-05-10 17:08:19,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:19,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:08:19,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:19,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b664379c7180ed7862d4 HTTP/1.1" 200 None 2026-05-10 17:08:19,729 - lava_callback - INFO - Completed processing callback for node 6a00b664379c7180ed7862d4 INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:08:30,522 - lava_callback - INFO - Received callback for node 69fe1888e4d4e78cd76b0c9e INFO: 172.21.0.1:39742 - "POST /node/69fe1888e4d4e78cd76b0c9e HTTP/1.0" 202 Accepted 2026-05-10 17:08:30,532 - lava_callback - INFO - Starting async job submit for node 69fe1888e4d4e78cd76b0c9e 2026-05-10 17:08:30,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:30,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1888e4d4e78cd76b0c9e HTTP/1.1" 200 None 2026-05-10 17:08:30,559 - lava_callback - DEBUG - Processing node 69fe1888e4d4e78cd76b0c9e: baseline-arm64-clabbe 2026-05-10 17:08:30,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1888e4d4e78cd76b0c9e 2026-05-10 17:08:30,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:30,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1888e4d4e78cd76b0c9e HTTP/1.1" 200 None 2026-05-10 17:08:30,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:30,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:08:30,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:30,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1888e4d4e78cd76b0c9e HTTP/1.1" 200 None 2026-05-10 17:08:30,624 - lava_callback - ERROR - Error processing callback for node 69fe1888e4d4e78cd76b0c9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:08:49,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:08:49,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:09:12,224 - lava_callback - INFO - Received callback for node 6a00b6f2379c7180ed7863cc INFO: 172.21.0.1:59126 - "POST /node/6a00b6f2379c7180ed7863cc HTTP/1.0" 202 Accepted 2026-05-10 17:09:12,232 - lava_callback - INFO - Starting async job submit for node 6a00b6f2379c7180ed7863cc 2026-05-10 17:09:12,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:12,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f2379c7180ed7863cc HTTP/1.1" 200 None 2026-05-10 17:09:12,291 - lava_callback - DEBUG - Processing node 6a00b6f2379c7180ed7863cc: baseline-nfs-arm64 2026-05-10 17:09:13,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:13,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:13,654 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f2379c7180ed7863cc/log.txt.gz 2026-05-10 17:09:14,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:14,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:14,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f2379c7180ed7863cc/lava-logs.yaml 2026-05-10 17:09:14,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:14,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:14,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00b6f2379c7180ed7863cc/lava_callback.json.gz DEBUG: Setup failed for 6a00b6f2379c7180ed7863cc. Transitting job node result: incomplete -> fail 2026-05-10 17:09:14,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:14,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b6f2379c7180ed7863cc HTTP/1.1" 200 None 2026-05-10 17:09:14,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:14,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:09:14,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:14,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b6f2379c7180ed7863cc HTTP/1.1" 200 None 2026-05-10 17:09:14,920 - lava_callback - INFO - Completed processing callback for node 6a00b6f2379c7180ed7863cc INFO: 172.21.0.1:59138 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 17:09:16,222 - lava_callback - INFO - Received callback for node 6a00b666379c7180ed7862d7 INFO: 172.21.0.1:59140 - "POST /node/6a00b666379c7180ed7862d7 HTTP/1.0" 202 Accepted 2026-05-10 17:09:16,229 - lava_callback - INFO - Starting async job submit for node 6a00b666379c7180ed7862d7 2026-05-10 17:09:16,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:16,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b666379c7180ed7862d7 HTTP/1.1" 200 None 2026-05-10 17:09:16,287 - lava_callback - DEBUG - Processing node 6a00b666379c7180ed7862d7: ltp-controllers INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:09:16,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:16,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:16,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-6a00b666379c7180ed7862d7/log.txt.gz 2026-05-10 17:09:17,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:17,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:17,392 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-6a00b666379c7180ed7862d7/lava-logs.yaml 2026-05-10 17:09:17,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:17,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:17,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-6a00b666379c7180ed7862d7/lava_callback.json.gz 2026-05-10 17:09:17,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:17,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b666379c7180ed7862d7 HTTP/1.1" 200 None 2026-05-10 17:09:17,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:17,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:09:17,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:17,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b666379c7180ed7862d7 HTTP/1.1" 200 None 2026-05-10 17:09:17,605 - lava_callback - INFO - Completed processing callback for node 6a00b666379c7180ed7862d7 2026-05-10 17:09:19,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:19,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:09:56,164 - lava_callback - INFO - Received callback for node 6a00bbc5379c7180ed786819 INFO: 172.21.0.1:47898 - "POST /node/6a00bbc5379c7180ed786819 HTTP/1.0" 202 Accepted 2026-05-10 17:09:56,170 - lava_callback - INFO - Starting async job submit for node 6a00bbc5379c7180ed786819 2026-05-10 17:09:56,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:56,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bbc5379c7180ed786819 HTTP/1.1" 200 None 2026-05-10 17:09:56,187 - lava_callback - DEBUG - Processing node 6a00bbc5379c7180ed786819: baseline-nfs-arm64 2026-05-10 17:09:56,188 - lava_callback - WARNING - Failed to upload log 2026-05-10 17:09:56,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:56,287 - lava_callback - INFO - Received callback for node 6a00b668379c7180ed7862da INFO: 172.21.0.1:47906 - "POST /node/6a00b668379c7180ed7862da HTTP/1.0" 202 Accepted 2026-05-10 17:09:56,293 - lava_callback - INFO - Starting async job submit for node 6a00b668379c7180ed7862da 2026-05-10 17:09:56,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:56,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:56,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00bbc5379c7180ed786819/lava-logs.yaml 2026-05-10 17:09:56,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:56,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b668379c7180ed7862da HTTP/1.1" 200 None 2026-05-10 17:09:56,337 - lava_callback - DEBUG - Processing node 6a00b668379c7180ed7862da: ltp-cve 2026-05-10 17:09:56,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:56,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00bbc5379c7180ed786819/lava_callback.json.gz 2026-05-10 17:09:56,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:09:56,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bbc5379c7180ed786819 HTTP/1.1" 200 None 2026-05-10 17:09:56,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:56,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:09:56,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:56,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bbc5379c7180ed786819 HTTP/1.1" 200 None 2026-05-10 17:09:56,821 - lava_callback - INFO - Completed processing callback for node 6a00bbc5379c7180ed786819 2026-05-10 17:09:56,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:56,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:56,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-6a00b668379c7180ed7862da/log.txt.gz 2026-05-10 17:09:57,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:57,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:57,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-6a00b668379c7180ed7862da/lava-logs.yaml 2026-05-10 17:09:57,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:09:57,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:09:57,518 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-6a00b668379c7180ed7862da/lava_callback.json.gz 2026-05-10 17:09:57,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:57,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b668379c7180ed7862da HTTP/1.1" 200 None 2026-05-10 17:09:57,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:57,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:09:57,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:09:57,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b668379c7180ed7862da HTTP/1.1" 200 None 2026-05-10 17:09:57,602 - lava_callback - INFO - Completed processing callback for node 6a00b668379c7180ed7862da INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:10:11,101 - lava_callback - INFO - Received callback for node 69fe18dce4d4e78cd76b0ccc INFO: 172.21.0.1:45966 - "POST /node/69fe18dce4d4e78cd76b0ccc HTTP/1.0" 202 Accepted 2026-05-10 17:10:11,107 - lava_callback - INFO - Starting async job submit for node 69fe18dce4d4e78cd76b0ccc 2026-05-10 17:10:11,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:10:11,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe18dce4d4e78cd76b0ccc HTTP/1.1" 200 None 2026-05-10 17:10:11,130 - lava_callback - DEBUG - Processing node 69fe18dce4d4e78cd76b0ccc: baseline-arm64-clabbe 2026-05-10 17:10:11,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe18dce4d4e78cd76b0ccc 2026-05-10 17:10:11,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:10:11,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe18dce4d4e78cd76b0ccc HTTP/1.1" 200 None 2026-05-10 17:10:11,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:10:11,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:10:11,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:10:11,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe18dce4d4e78cd76b0ccc HTTP/1.1" 200 None 2026-05-10 17:10:11,185 - lava_callback - ERROR - Error processing callback for node 69fe18dce4d4e78cd76b0ccc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45978 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:10:19,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:10:19,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:11:50,446 - lava_callback - INFO - Received callback for node 6a00bb37379c7180ed7867ad INFO: 172.21.0.1:58172 - "POST /node/6a00bb37379c7180ed7867ad HTTP/1.0" 202 Accepted 2026-05-10 17:11:50,456 - lava_callback - INFO - Starting async job submit for node 6a00bb37379c7180ed7867ad 2026-05-10 17:11:50,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:11:50,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bb37379c7180ed7867ad HTTP/1.1" 200 None 2026-05-10 17:11:50,575 - lava_callback - DEBUG - Processing node 6a00bb37379c7180ed7867ad: baseline-arm64-foundriesio 2026-05-10 17:11:51,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:11:51,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:11:51,940 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00bb37379c7180ed7867ad/log.txt.gz 2026-05-10 17:11:52,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:11:52,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:11:52,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00bb37379c7180ed7867ad/lava-logs.yaml 2026-05-10 17:11:52,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:11:53,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:11:53,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00bb37379c7180ed7867ad/lava_callback.json.gz DEBUG: 6a00bb37379c7180ed7867ad Transitting job node result: pass -> incomplete 2026-05-10 17:11:53,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:11:53,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bb37379c7180ed7867ad HTTP/1.1" 200 None 2026-05-10 17:11:53,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:11:53,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:11:53,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:11:53,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bb37379c7180ed7867ad HTTP/1.1" 200 None 2026-05-10 17:11:53,174 - lava_callback - INFO - Completed processing callback for node 6a00bb37379c7180ed7867ad INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:12:06,726 - lava_callback - INFO - Received callback for node 6a00bc56379c7180ed786866 INFO: 172.21.0.1:38842 - "POST /node/6a00bc56379c7180ed786866 HTTP/1.0" 202 Accepted 2026-05-10 17:12:06,732 - lava_callback - INFO - Starting async job submit for node 6a00bc56379c7180ed786866 2026-05-10 17:12:06,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:06,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bc56379c7180ed786866 HTTP/1.1" 200 None 2026-05-10 17:12:06,754 - lava_callback - DEBUG - Processing node 6a00bc56379c7180ed786866: baseline-arm 2026-05-10 17:12:06,759 - lava_callback - WARNING - Failed to upload log 2026-05-10 17:12:06,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:12:06,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:12:06,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00bc56379c7180ed786866/lava-logs.yaml 2026-05-10 17:12:06,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:12:06,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:12:06,930 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00bc56379c7180ed786866/lava_callback.json.gz 2026-05-10 17:12:06,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:06,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bc56379c7180ed786866 HTTP/1.1" 200 None 2026-05-10 17:12:06,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:06,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:12:06,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:06,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bc56379c7180ed786866 HTTP/1.1" 200 None 2026-05-10 17:12:06,996 - lava_callback - INFO - Completed processing callback for node 6a00bc56379c7180ed786866 INFO: 172.21.0.1:57520 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 17:12:16,329 - lava_callback - INFO - Received callback for node 6a00b66e379c7180ed7862e6 INFO: 172.21.0.1:57534 - "POST /node/6a00b66e379c7180ed7862e6 HTTP/1.0" 202 Accepted 2026-05-10 17:12:16,335 - lava_callback - INFO - Starting async job submit for node 6a00b66e379c7180ed7862e6 2026-05-10 17:12:16,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:16,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b66e379c7180ed7862e6 HTTP/1.1" 200 None 2026-05-10 17:12:16,374 - lava_callback - DEBUG - Processing node 6a00b66e379c7180ed7862e6: ltp-fsx INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:12:16,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:12:16,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:12:16,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-6a00b66e379c7180ed7862e6/log.txt.gz 2026-05-10 17:12:17,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:12:17,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:12:17,326 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-6a00b66e379c7180ed7862e6/lava-logs.yaml 2026-05-10 17:12:17,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:12:17,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:12:17,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-6a00b66e379c7180ed7862e6/lava_callback.json.gz 2026-05-10 17:12:17,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:17,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b66e379c7180ed7862e6 HTTP/1.1" 200 None 2026-05-10 17:12:17,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:17,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:12:17,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:17,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b66e379c7180ed7862e6 HTTP/1.1" 200 None 2026-05-10 17:12:17,578 - lava_callback - INFO - Completed processing callback for node 6a00b66e379c7180ed7862e6 2026-05-10 17:12:18,775 - lava_callback - INFO - Received callback for node 6a00b66c379c7180ed7862e3 INFO: 172.21.0.1:57548 - "POST /node/6a00b66c379c7180ed7862e3 HTTP/1.0" 202 Accepted 2026-05-10 17:12:18,782 - lava_callback - INFO - Starting async job submit for node 6a00b66c379c7180ed7862e3 2026-05-10 17:12:18,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:18,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b66c379c7180ed7862e3 HTTP/1.1" 200 None 2026-05-10 17:12:18,821 - lava_callback - DEBUG - Processing node 6a00b66c379c7180ed7862e3: ltp-fs_bind 2026-05-10 17:12:19,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:12:19,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:12:19,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-6a00b66c379c7180ed7862e3/log.txt.gz 2026-05-10 17:12:19,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:19,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 17:12:19,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:12:19,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:12:19,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-6a00b66c379c7180ed7862e3/lava-logs.yaml 2026-05-10 17:12:19,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:12:19,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:12:19,785 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-6a00b66c379c7180ed7862e3/lava_callback.json.gz 2026-05-10 17:12:19,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:19,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b66c379c7180ed7862e3 HTTP/1.1" 200 None 2026-05-10 17:12:19,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:19,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:12:19,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:19,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b66c379c7180ed7862e3 HTTP/1.1" 200 None 2026-05-10 17:12:19,872 - lava_callback - INFO - Completed processing callback for node 6a00b66c379c7180ed7862e3 INFO: 172.21.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:12:49,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:49,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 17:12:50,663 - lava_callback - INFO - Received callback for node 69fe1983e4d4e78cd76b0d1a INFO: 172.21.0.1:38152 - "POST /node/69fe1983e4d4e78cd76b0d1a HTTP/1.0" 202 Accepted 2026-05-10 17:12:50,672 - lava_callback - INFO - Starting async job submit for node 69fe1983e4d4e78cd76b0d1a 2026-05-10 17:12:50,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:50,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1983e4d4e78cd76b0d1a HTTP/1.1" 200 None 2026-05-10 17:12:50,688 - lava_callback - DEBUG - Processing node 69fe1983e4d4e78cd76b0d1a: baseline-arm64-clabbe 2026-05-10 17:12:50,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1983e4d4e78cd76b0d1a 2026-05-10 17:12:50,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:50,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1983e4d4e78cd76b0d1a HTTP/1.1" 200 None 2026-05-10 17:12:50,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:50,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:12:50,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:12:50,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1983e4d4e78cd76b0d1a HTTP/1.1" 200 None 2026-05-10 17:12:50,752 - lava_callback - ERROR - Error processing callback for node 69fe1983e4d4e78cd76b0d1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:13:27,372 - lava_callback - INFO - Received callback for node 6a00bc7c379c7180ed78688d INFO: 172.21.0.1:42276 - "POST /node/6a00bc7c379c7180ed78688d HTTP/1.0" 202 Accepted 2026-05-10 17:13:27,379 - lava_callback - INFO - Starting async job submit for node 6a00bc7c379c7180ed78688d 2026-05-10 17:13:27,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:27,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bc7c379c7180ed78688d HTTP/1.1" 200 None 2026-05-10 17:13:27,423 - lava_callback - DEBUG - Processing node 6a00bc7c379c7180ed78688d: baseline-arm64 2026-05-10 17:13:27,594 - lava_callback - WARNING - Failed to upload log 2026-05-10 17:13:27,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:13:27,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:13:27,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bc7c379c7180ed78688d/lava-logs.yaml 2026-05-10 17:13:27,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:13:27,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:13:27,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bc7c379c7180ed78688d/lava_callback.json.gz 2026-05-10 17:13:27,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:27,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bc7c379c7180ed78688d HTTP/1.1" 200 None 2026-05-10 17:13:27,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:27,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:13:27,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:27,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bc7c379c7180ed78688d HTTP/1.1" 200 None 2026-05-10 17:13:28,057 - lava_callback - INFO - Completed processing callback for node 6a00bc7c379c7180ed78688d INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:13:49,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:49,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 17:13:50,414 - lava_callback - INFO - Received callback for node 69fe19b9e4d4e78cd76b0db2 INFO: 172.21.0.1:55732 - "POST /node/69fe19b9e4d4e78cd76b0db2 HTTP/1.0" 202 Accepted 2026-05-10 17:13:50,420 - lava_callback - INFO - Starting async job submit for node 69fe19b9e4d4e78cd76b0db2 2026-05-10 17:13:50,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:50,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b9e4d4e78cd76b0db2 HTTP/1.1" 200 None 2026-05-10 17:13:50,436 - lava_callback - DEBUG - Processing node 69fe19b9e4d4e78cd76b0db2: baseline-arm64-baylibre 2026-05-10 17:13:50,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19b9e4d4e78cd76b0db2 2026-05-10 17:13:50,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:50,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19b9e4d4e78cd76b0db2 HTTP/1.1" 200 None 2026-05-10 17:13:50,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:50,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:13:50,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:50,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19b9e4d4e78cd76b0db2 HTTP/1.1" 200 None 2026-05-10 17:13:50,500 - lava_callback - ERROR - Error processing callback for node 69fe19b9e4d4e78cd76b0db2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:13:51,100 - lava_callback - INFO - Received callback for node 69fe19bae4d4e78cd76b0db5 INFO: 172.21.0.1:55740 - "POST /node/69fe19bae4d4e78cd76b0db5 HTTP/1.0" 202 Accepted 2026-05-10 17:13:51,108 - lava_callback - INFO - Starting async job submit for node 69fe19bae4d4e78cd76b0db5 2026-05-10 17:13:51,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:51,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19bae4d4e78cd76b0db5 HTTP/1.1" 200 None 2026-05-10 17:13:51,123 - lava_callback - DEBUG - Processing node 69fe19bae4d4e78cd76b0db5: baseline-arm64-baylibre 2026-05-10 17:13:51,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19bae4d4e78cd76b0db5 2026-05-10 17:13:51,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:51,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19bae4d4e78cd76b0db5 HTTP/1.1" 200 None 2026-05-10 17:13:51,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:51,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:13:51,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:51,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19bae4d4e78cd76b0db5 HTTP/1.1" 200 None 2026-05-10 17:13:51,179 - lava_callback - ERROR - Error processing callback for node 69fe19bae4d4e78cd76b0db5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:13:51,784 - lava_callback - INFO - Received callback for node 69fe19bce4d4e78cd76b0db8 INFO: 172.21.0.1:55752 - "POST /node/69fe19bce4d4e78cd76b0db8 HTTP/1.0" 202 Accepted 2026-05-10 17:13:51,790 - lava_callback - INFO - Starting async job submit for node 69fe19bce4d4e78cd76b0db8 2026-05-10 17:13:51,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:51,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19bce4d4e78cd76b0db8 HTTP/1.1" 200 None 2026-05-10 17:13:51,805 - lava_callback - DEBUG - Processing node 69fe19bce4d4e78cd76b0db8: baseline-arm64-baylibre 2026-05-10 17:13:51,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19bce4d4e78cd76b0db8 2026-05-10 17:13:51,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:51,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19bce4d4e78cd76b0db8 HTTP/1.1" 200 None 2026-05-10 17:13:51,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:51,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:13:51,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:51,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19bce4d4e78cd76b0db8 HTTP/1.1" 200 None 2026-05-10 17:13:51,856 - lava_callback - ERROR - Error processing callback for node 69fe19bce4d4e78cd76b0db8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:13:52,459 - lava_callback - INFO - Received callback for node 69fe19bee4d4e78cd76b0dbf INFO: 172.21.0.1:55758 - "POST /node/69fe19bee4d4e78cd76b0dbf HTTP/1.0" 202 Accepted 2026-05-10 17:13:52,465 - lava_callback - INFO - Starting async job submit for node 69fe19bee4d4e78cd76b0dbf 2026-05-10 17:13:52,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:52,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19bee4d4e78cd76b0dbf HTTP/1.1" 200 None 2026-05-10 17:13:52,479 - lava_callback - DEBUG - Processing node 69fe19bee4d4e78cd76b0dbf: baseline-arm64-baylibre 2026-05-10 17:13:52,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19bee4d4e78cd76b0dbf 2026-05-10 17:13:52,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:52,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19bee4d4e78cd76b0dbf HTTP/1.1" 200 None 2026-05-10 17:13:52,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:52,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:13:52,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:52,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19bee4d4e78cd76b0dbf HTTP/1.1" 200 None 2026-05-10 17:13:52,529 - lava_callback - ERROR - Error processing callback for node 69fe19bee4d4e78cd76b0dbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:13:53,127 - lava_callback - INFO - Received callback for node 69fe19c0e4d4e78cd76b0dc2 INFO: 172.21.0.1:55760 - "POST /node/69fe19c0e4d4e78cd76b0dc2 HTTP/1.0" 202 Accepted 2026-05-10 17:13:53,132 - lava_callback - INFO - Starting async job submit for node 69fe19c0e4d4e78cd76b0dc2 2026-05-10 17:13:53,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:53,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c0e4d4e78cd76b0dc2 HTTP/1.1" 200 None 2026-05-10 17:13:53,149 - lava_callback - DEBUG - Processing node 69fe19c0e4d4e78cd76b0dc2: baseline-arm64-baylibre 2026-05-10 17:13:53,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19c0e4d4e78cd76b0dc2 2026-05-10 17:13:53,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:53,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c0e4d4e78cd76b0dc2 HTTP/1.1" 200 None 2026-05-10 17:13:53,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:53,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:13:53,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:53,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19c0e4d4e78cd76b0dc2 HTTP/1.1" 200 None 2026-05-10 17:13:53,223 - lava_callback - ERROR - Error processing callback for node 69fe19c0e4d4e78cd76b0dc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:13:53,771 - lava_callback - INFO - Received callback for node 69fe19c1e4d4e78cd76b0dc5 INFO: 172.21.0.1:55776 - "POST /node/69fe19c1e4d4e78cd76b0dc5 HTTP/1.0" 202 Accepted 2026-05-10 17:13:53,777 - lava_callback - INFO - Starting async job submit for node 69fe19c1e4d4e78cd76b0dc5 2026-05-10 17:13:53,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:53,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c1e4d4e78cd76b0dc5 HTTP/1.1" 200 None 2026-05-10 17:13:53,794 - lava_callback - DEBUG - Processing node 69fe19c1e4d4e78cd76b0dc5: baseline-arm64-baylibre 2026-05-10 17:13:53,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19c1e4d4e78cd76b0dc5 2026-05-10 17:13:53,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:53,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c1e4d4e78cd76b0dc5 HTTP/1.1" 200 None 2026-05-10 17:13:53,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:53,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:13:53,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:53,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19c1e4d4e78cd76b0dc5 HTTP/1.1" 200 None 2026-05-10 17:13:53,854 - lava_callback - ERROR - Error processing callback for node 69fe19c1e4d4e78cd76b0dc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:13:56,381 - lava_callback - INFO - Received callback for node 6a00b66f379c7180ed7862e9 INFO: 172.21.0.1:55782 - "POST /node/6a00b66f379c7180ed7862e9 HTTP/1.0" 202 Accepted 2026-05-10 17:13:56,387 - lava_callback - INFO - Starting async job submit for node 6a00b66f379c7180ed7862e9 2026-05-10 17:13:56,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:56,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b66f379c7180ed7862e9 HTTP/1.1" 200 None 2026-05-10 17:13:56,426 - lava_callback - DEBUG - Processing node 6a00b66f379c7180ed7862e9: ltp-input INFO: 172.21.0.1:55796 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:13:56,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:13:56,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:13:56,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-6a00b66f379c7180ed7862e9/log.txt.gz 2026-05-10 17:13:57,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:13:57,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:13:57,400 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-6a00b66f379c7180ed7862e9/lava-logs.yaml 2026-05-10 17:13:57,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:13:57,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:13:57,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-6a00b66f379c7180ed7862e9/lava_callback.json.gz 2026-05-10 17:13:57,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:57,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b66f379c7180ed7862e9 HTTP/1.1" 200 None 2026-05-10 17:13:57,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:57,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:13:57,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:57,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b66f379c7180ed7862e9 HTTP/1.1" 200 None 2026-05-10 17:13:57,626 - lava_callback - INFO - Completed processing callback for node 6a00b66f379c7180ed7862e9 2026-05-10 17:13:57,984 - lava_callback - INFO - Received callback for node 6a00b671379c7180ed7862ec INFO: 172.21.0.1:55808 - "POST /node/6a00b671379c7180ed7862ec HTTP/1.0" 202 Accepted 2026-05-10 17:13:57,991 - lava_callback - INFO - Starting async job submit for node 6a00b671379c7180ed7862ec 2026-05-10 17:13:58,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:58,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b671379c7180ed7862ec HTTP/1.1" 200 None 2026-05-10 17:13:58,033 - lava_callback - DEBUG - Processing node 6a00b671379c7180ed7862ec: ltp-ipc 2026-05-10 17:13:58,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:13:58,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:13:58,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-6a00b671379c7180ed7862ec/log.txt.gz 2026-05-10 17:13:58,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:13:58,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:13:58,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-6a00b671379c7180ed7862ec/lava-logs.yaml 2026-05-10 17:13:58,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:13:58,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:13:58,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-6a00b671379c7180ed7862ec/lava_callback.json.gz 2026-05-10 17:13:58,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:58,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b671379c7180ed7862ec HTTP/1.1" 200 None 2026-05-10 17:13:58,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:58,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:13:58,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:13:59,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b671379c7180ed7862ec HTTP/1.1" 200 None 2026-05-10 17:13:59,012 - lava_callback - INFO - Completed processing callback for node 6a00b671379c7180ed7862ec INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:14:10,699 - lava_callback - INFO - Received callback for node 69fe19d1e4d4e78cd76b0e0d INFO: 172.21.0.1:51410 - "POST /node/69fe19d1e4d4e78cd76b0e0d HTTP/1.0" 202 Accepted 2026-05-10 17:14:10,705 - lava_callback - INFO - Starting async job submit for node 69fe19d1e4d4e78cd76b0e0d 2026-05-10 17:14:10,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:10,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d1e4d4e78cd76b0e0d HTTP/1.1" 200 None 2026-05-10 17:14:10,727 - lava_callback - DEBUG - Processing node 69fe19d1e4d4e78cd76b0e0d: baseline-arm64-clabbe 2026-05-10 17:14:10,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19d1e4d4e78cd76b0e0d 2026-05-10 17:14:10,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:10,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d1e4d4e78cd76b0e0d HTTP/1.1" 200 None 2026-05-10 17:14:10,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:10,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:14:10,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:10,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19d1e4d4e78cd76b0e0d HTTP/1.1" 200 None 2026-05-10 17:14:10,773 - lava_callback - ERROR - Error processing callback for node 69fe19d1e4d4e78cd76b0e0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:14:11,376 - lava_callback - INFO - Received callback for node 69fe19d3e4d4e78cd76b0e12 INFO: 172.21.0.1:51416 - "POST /node/69fe19d3e4d4e78cd76b0e12 HTTP/1.0" 202 Accepted 2026-05-10 17:14:11,382 - lava_callback - INFO - Starting async job submit for node 69fe19d3e4d4e78cd76b0e12 2026-05-10 17:14:11,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:11,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d3e4d4e78cd76b0e12 HTTP/1.1" 200 None 2026-05-10 17:14:11,397 - lava_callback - DEBUG - Processing node 69fe19d3e4d4e78cd76b0e12: baseline-arm64-clabbe 2026-05-10 17:14:11,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19d3e4d4e78cd76b0e12 2026-05-10 17:14:11,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:11,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d3e4d4e78cd76b0e12 HTTP/1.1" 200 None 2026-05-10 17:14:11,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:11,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:14:11,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:11,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19d3e4d4e78cd76b0e12 HTTP/1.1" 200 None 2026-05-10 17:14:11,460 - lava_callback - ERROR - Error processing callback for node 69fe19d3e4d4e78cd76b0e12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:14:12,053 - lava_callback - INFO - Received callback for node 69fe19d4e4d4e78cd76b0e15 INFO: 172.21.0.1:51432 - "POST /node/69fe19d4e4d4e78cd76b0e15 HTTP/1.0" 202 Accepted 2026-05-10 17:14:12,058 - lava_callback - INFO - Starting async job submit for node 69fe19d4e4d4e78cd76b0e15 2026-05-10 17:14:12,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:12,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d4e4d4e78cd76b0e15 HTTP/1.1" 200 None 2026-05-10 17:14:12,074 - lava_callback - DEBUG - Processing node 69fe19d4e4d4e78cd76b0e15: baseline-arm64-clabbe 2026-05-10 17:14:12,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19d4e4d4e78cd76b0e15 2026-05-10 17:14:12,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:12,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d4e4d4e78cd76b0e15 HTTP/1.1" 200 None 2026-05-10 17:14:12,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:12,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:14:12,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:12,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19d4e4d4e78cd76b0e15 HTTP/1.1" 200 None 2026-05-10 17:14:12,146 - lava_callback - ERROR - Error processing callback for node 69fe19d4e4d4e78cd76b0e15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:14:12,713 - lava_callback - INFO - Received callback for node 69fe19dae4d4e78cd76b0e2d INFO: 172.21.0.1:51448 - "POST /node/69fe19dae4d4e78cd76b0e2d HTTP/1.0" 202 Accepted 2026-05-10 17:14:12,718 - lava_callback - INFO - Starting async job submit for node 69fe19dae4d4e78cd76b0e2d 2026-05-10 17:14:12,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:12,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dae4d4e78cd76b0e2d HTTP/1.1" 200 None 2026-05-10 17:14:12,734 - lava_callback - DEBUG - Processing node 69fe19dae4d4e78cd76b0e2d: baseline-arm64-clabbe 2026-05-10 17:14:12,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19dae4d4e78cd76b0e2d 2026-05-10 17:14:12,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:12,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19dae4d4e78cd76b0e2d HTTP/1.1" 200 None 2026-05-10 17:14:12,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:12,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:14:12,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:12,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19dae4d4e78cd76b0e2d HTTP/1.1" 200 None 2026-05-10 17:14:12,801 - lava_callback - ERROR - Error processing callback for node 69fe19dae4d4e78cd76b0e2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:14:13,397 - lava_callback - INFO - Received callback for node 69fe19d5e4d4e78cd76b0e18 INFO: 172.21.0.1:51462 - "POST /node/69fe19d5e4d4e78cd76b0e18 HTTP/1.0" 202 Accepted 2026-05-10 17:14:13,403 - lava_callback - INFO - Starting async job submit for node 69fe19d5e4d4e78cd76b0e18 2026-05-10 17:14:13,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:13,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d5e4d4e78cd76b0e18 HTTP/1.1" 200 None 2026-05-10 17:14:13,418 - lava_callback - DEBUG - Processing node 69fe19d5e4d4e78cd76b0e18: baseline-arm64-clabbe 2026-05-10 17:14:13,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19d5e4d4e78cd76b0e18 2026-05-10 17:14:13,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:13,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d5e4d4e78cd76b0e18 HTTP/1.1" 200 None 2026-05-10 17:14:13,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:13,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:14:13,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:13,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19d5e4d4e78cd76b0e18 HTTP/1.1" 200 None 2026-05-10 17:14:13,466 - lava_callback - ERROR - Error processing callback for node 69fe19d5e4d4e78cd76b0e18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:14:14,082 - lava_callback - INFO - Received callback for node 69fe19d8e4d4e78cd76b0e21 INFO: 172.21.0.1:51476 - "POST /node/69fe19d8e4d4e78cd76b0e21 HTTP/1.0" 202 Accepted 2026-05-10 17:14:14,088 - lava_callback - INFO - Starting async job submit for node 69fe19d8e4d4e78cd76b0e21 2026-05-10 17:14:14,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:14,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d8e4d4e78cd76b0e21 HTTP/1.1" 200 None 2026-05-10 17:14:14,103 - lava_callback - DEBUG - Processing node 69fe19d8e4d4e78cd76b0e21: baseline-arm64-clabbe 2026-05-10 17:14:14,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19d8e4d4e78cd76b0e21 2026-05-10 17:14:14,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:14,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d8e4d4e78cd76b0e21 HTTP/1.1" 200 None 2026-05-10 17:14:14,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:14,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:14:14,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:14,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19d8e4d4e78cd76b0e21 HTTP/1.1" 200 None 2026-05-10 17:14:14,147 - lava_callback - ERROR - Error processing callback for node 69fe19d8e4d4e78cd76b0e21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 17:14:14,762 - lava_callback - INFO - Received callback for node 69fe19d7e4d4e78cd76b0e1e INFO: 172.21.0.1:51482 - "POST /node/69fe19d7e4d4e78cd76b0e1e HTTP/1.0" 202 Accepted 2026-05-10 17:14:14,772 - lava_callback - INFO - Starting async job submit for node 69fe19d7e4d4e78cd76b0e1e 2026-05-10 17:14:14,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:14,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d7e4d4e78cd76b0e1e HTTP/1.1" 200 None 2026-05-10 17:14:14,796 - lava_callback - DEBUG - Processing node 69fe19d7e4d4e78cd76b0e1e: baseline-arm64-clabbe 2026-05-10 17:14:14,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe19d7e4d4e78cd76b0e1e 2026-05-10 17:14:14,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:14,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19d7e4d4e78cd76b0e1e HTTP/1.1" 200 None 2026-05-10 17:14:14,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:14,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 17:14:14,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:14,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19d7e4d4e78cd76b0e1e HTTP/1.1" 200 None 2026-05-10 17:14:14,853 - lava_callback - ERROR - Error processing callback for node 69fe19d7e4d4e78cd76b0e1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:14:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:19,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:14:46,977 - lava_callback - INFO - Received callback for node 6a00bcca379c7180ed7868b4 INFO: 172.21.0.1:42124 - "POST /node/6a00bcca379c7180ed7868b4 HTTP/1.0" 202 Accepted 2026-05-10 17:14:46,984 - lava_callback - INFO - Starting async job submit for node 6a00bcca379c7180ed7868b4 2026-05-10 17:14:47,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:47,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bcca379c7180ed7868b4 HTTP/1.1" 200 None 2026-05-10 17:14:47,029 - lava_callback - DEBUG - Processing node 6a00bcca379c7180ed7868b4: baseline-arm64 2026-05-10 17:14:47,167 - lava_callback - WARNING - Failed to upload log 2026-05-10 17:14:47,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:14:47,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:14:47,363 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bcca379c7180ed7868b4/lava-logs.yaml 2026-05-10 17:14:47,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:14:47,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:14:47,443 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bcca379c7180ed7868b4/lava_callback.json.gz 2026-05-10 17:14:47,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:47,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bcca379c7180ed7868b4 HTTP/1.1" 200 None 2026-05-10 17:14:47,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:47,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:14:47,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:47,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bcca379c7180ed7868b4 HTTP/1.1" 200 None 2026-05-10 17:14:47,604 - lava_callback - INFO - Completed processing callback for node 6a00bcca379c7180ed7868b4 2026-05-10 17:14:49,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:14:49,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 17:16:16,460 - lava_callback - INFO - Received callback for node 6a00b673379c7180ed7862ef INFO: 172.21.0.1:44020 - "POST /node/6a00b673379c7180ed7862ef HTTP/1.0" 202 Accepted 2026-05-10 17:16:16,467 - lava_callback - INFO - Starting async job submit for node 6a00b673379c7180ed7862ef 2026-05-10 17:16:16,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:16:16,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b673379c7180ed7862ef HTTP/1.1" 200 None 2026-05-10 17:16:16,506 - lava_callback - DEBUG - Processing node 6a00b673379c7180ed7862ef: ltp-pty 2026-05-10 17:16:17,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:16:17,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:16:17,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-6a00b673379c7180ed7862ef/log.txt.gz 2026-05-10 17:16:17,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:16:17,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:16:17,694 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-6a00b673379c7180ed7862ef/lava-logs.yaml 2026-05-10 17:16:17,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:16:17,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:16:17,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-6a00b673379c7180ed7862ef/lava_callback.json.gz 2026-05-10 17:16:17,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:17,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b673379c7180ed7862ef HTTP/1.1" 200 None 2026-05-10 17:16:17,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:17,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:16:17,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:17,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b673379c7180ed7862ef HTTP/1.1" 200 None 2026-05-10 17:16:17,906 - lava_callback - INFO - Completed processing callback for node 6a00b673379c7180ed7862ef 2026-05-10 17:16:17,968 - lava_callback - INFO - Received callback for node 6a00b674379c7180ed7862f2 INFO: 172.21.0.1:44034 - "POST /node/6a00b674379c7180ed7862f2 HTTP/1.0" 202 Accepted 2026-05-10 17:16:17,979 - lava_callback - INFO - Starting async job submit for node 6a00b674379c7180ed7862f2 2026-05-10 17:16:18,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:18,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b674379c7180ed7862f2 HTTP/1.1" 200 None 2026-05-10 17:16:18,047 - lava_callback - DEBUG - Processing node 6a00b674379c7180ed7862f2: ltp-sched 2026-05-10 17:16:18,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:16:18,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:16:18,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-6a00b674379c7180ed7862f2/log.txt.gz 2026-05-10 17:16:18,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:16:18,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:16:18,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-6a00b674379c7180ed7862f2/lava-logs.yaml 2026-05-10 17:16:18,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:16:19,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:16:19,038 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-6a00b674379c7180ed7862f2/lava_callback.json.gz 2026-05-10 17:16:19,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:19,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b674379c7180ed7862f2 HTTP/1.1" 200 None 2026-05-10 17:16:19,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:19,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:16:19,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:19,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b674379c7180ed7862f2 HTTP/1.1" 200 None 2026-05-10 17:16:19,113 - lava_callback - INFO - Completed processing callback for node 6a00b674379c7180ed7862f2 2026-05-10 17:16:19,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:19,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:16:50,935 - lava_callback - INFO - Received callback for node 69fe1a7de4d4e78cd76b0f79 INFO: 172.21.0.1:48056 - "POST /node/69fe1a7de4d4e78cd76b0f79 HTTP/1.0" 202 Accepted 2026-05-10 17:16:50,941 - lava_callback - INFO - Starting async job submit for node 69fe1a7de4d4e78cd76b0f79 2026-05-10 17:16:50,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:50,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1a7de4d4e78cd76b0f79 HTTP/1.1" 200 None 2026-05-10 17:16:50,956 - lava_callback - DEBUG - Processing node 69fe1a7de4d4e78cd76b0f79: baseline-arm64-clabbe 2026-05-10 17:16:50,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1a7de4d4e78cd76b0f79 2026-05-10 17:16:50,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:50,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1a7de4d4e78cd76b0f79 HTTP/1.1" 200 None 2026-05-10 17:16:50,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:50,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:16:50,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:16:51,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1a7de4d4e78cd76b0f79 HTTP/1.1" 200 None 2026-05-10 17:16:51,001 - lava_callback - ERROR - Error processing callback for node 69fe1a7de4d4e78cd76b0f79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:17:56,780 - lava_callback - INFO - Received callback for node 6a00b676379c7180ed7862f9 INFO: 172.21.0.1:47774 - "POST /node/6a00b676379c7180ed7862f9 HTTP/1.0" 202 Accepted 2026-05-10 17:17:56,787 - lava_callback - INFO - Starting async job submit for node 6a00b676379c7180ed7862f9 2026-05-10 17:17:56,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:17:56,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b676379c7180ed7862f9 HTTP/1.1" 200 None 2026-05-10 17:17:56,836 - lava_callback - DEBUG - Processing node 6a00b676379c7180ed7862f9: ltp-smoke 2026-05-10 17:17:57,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:17:57,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:17:57,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b676379c7180ed7862f9/log.txt.gz 2026-05-10 17:17:57,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:17:57,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:17:57,755 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b676379c7180ed7862f9/lava-logs.yaml 2026-05-10 17:17:57,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:17:57,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:17:57,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b676379c7180ed7862f9/lava_callback.json.gz 2026-05-10 17:17:57,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:17:57,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b676379c7180ed7862f9 HTTP/1.1" 200 None 2026-05-10 17:17:57,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:17:57,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:17:57,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:17:57,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b676379c7180ed7862f9 HTTP/1.1" 200 None 2026-05-10 17:17:57,975 - lava_callback - INFO - Completed processing callback for node 6a00b676379c7180ed7862f9 2026-05-10 17:17:58,051 - lava_callback - INFO - Received callback for node 6a00b9af379c7180ed786711 INFO: 172.21.0.1:47790 - "POST /node/6a00b9af379c7180ed786711 HTTP/1.0" 202 Accepted 2026-05-10 17:17:58,058 - lava_callback - INFO - Starting async job submit for node 6a00b9af379c7180ed786711 2026-05-10 17:17:58,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:17:58,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b9af379c7180ed786711 HTTP/1.1" 200 None 2026-05-10 17:17:58,168 - lava_callback - DEBUG - Processing node 6a00b9af379c7180ed786711: ltp-smoke 2026-05-10 17:17:58,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:17:58,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:17:58,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b9af379c7180ed786711/log.txt.gz 2026-05-10 17:17:59,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:17:59,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:17:59,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b9af379c7180ed786711/lava-logs.yaml 2026-05-10 17:17:59,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:17:59,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:17:59,640 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00b9af379c7180ed786711/lava_callback.json.gz 2026-05-10 17:17:59,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:17:59,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b9af379c7180ed786711 HTTP/1.1" 200 None 2026-05-10 17:17:59,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:17:59,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af89379c7180ed783980 HTTP/1.1" 200 None 2026-05-10 17:17:59,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:17:59,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b9af379c7180ed786711 HTTP/1.1" 200 None 2026-05-10 17:17:59,917 - lava_callback - INFO - Completed processing callback for node 6a00b9af379c7180ed786711 INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:18:11,609 - lava_callback - INFO - Received callback for node 6a00bc0f379c7180ed786841 INFO: 172.21.0.1:54536 - "POST /node/6a00bc0f379c7180ed786841 HTTP/1.0" 202 Accepted 2026-05-10 17:18:11,616 - lava_callback - INFO - Starting async job submit for node 6a00bc0f379c7180ed786841 2026-05-10 17:18:11,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:11,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bc0f379c7180ed786841 HTTP/1.1" 200 None 2026-05-10 17:18:11,674 - lava_callback - DEBUG - Processing node 6a00bc0f379c7180ed786841: baseline-arm64 2026-05-10 17:18:12,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:18:12,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:18:12,157 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bc0f379c7180ed786841/log.txt.gz 2026-05-10 17:18:12,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:18:12,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:18:12,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bc0f379c7180ed786841/lava-logs.yaml 2026-05-10 17:18:12,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:18:12,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:18:12,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bc0f379c7180ed786841/lava_callback.json.gz DEBUG: Setup failed for 6a00bc0f379c7180ed786841. Transitting job node result: incomplete -> fail 2026-05-10 17:18:12,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:12,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bc0f379c7180ed786841 HTTP/1.1" 200 None 2026-05-10 17:18:12,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:12,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:18:12,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:12,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bc0f379c7180ed786841 HTTP/1.1" 200 None 2026-05-10 17:18:12,839 - lava_callback - INFO - Completed processing callback for node 6a00bc0f379c7180ed786841 INFO: 172.21.0.1:54544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:18:19,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:19,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:18:36,561 - lava_callback - INFO - Received callback for node 6a00b679379c7180ed786306 INFO: 172.21.0.1:54846 - "POST /node/6a00b679379c7180ed786306 HTTP/1.0" 202 Accepted 2026-05-10 17:18:36,568 - lava_callback - INFO - Starting async job submit for node 6a00b679379c7180ed786306 2026-05-10 17:18:36,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:36,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b679379c7180ed786306 HTTP/1.1" 200 None 2026-05-10 17:18:36,644 - lava_callback - DEBUG - Processing node 6a00b679379c7180ed786306: ltp-syscalls-ipc 2026-05-10 17:18:37,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:18:37,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:18:37,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-6a00b679379c7180ed786306/log.txt.gz 2026-05-10 17:18:37,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:18:37,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:18:37,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-6a00b679379c7180ed786306/lava-logs.yaml 2026-05-10 17:18:37,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:18:37,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:18:37,862 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-6a00b679379c7180ed786306/lava_callback.json.gz 2026-05-10 17:18:37,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:37,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b679379c7180ed786306 HTTP/1.1" 200 None 2026-05-10 17:18:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:37,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:18:37,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:38,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b679379c7180ed786306 HTTP/1.1" 200 None 2026-05-10 17:18:38,010 - lava_callback - INFO - Completed processing callback for node 6a00b679379c7180ed786306 INFO: 172.21.0.1:54784 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:18:49,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:18:49,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:19:10,927 - lava_callback - INFO - Received callback for node 69fe1af9e4d4e78cd76b0fd0 INFO: 172.21.0.1:58924 - "POST /node/69fe1af9e4d4e78cd76b0fd0 HTTP/1.0" 202 Accepted 2026-05-10 17:19:10,933 - lava_callback - INFO - Starting async job submit for node 69fe1af9e4d4e78cd76b0fd0 2026-05-10 17:19:10,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:19:10,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1af9e4d4e78cd76b0fd0 HTTP/1.1" 200 None 2026-05-10 17:19:10,948 - lava_callback - DEBUG - Processing node 69fe1af9e4d4e78cd76b0fd0: baseline-arm64-clabbe 2026-05-10 17:19:10,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1af9e4d4e78cd76b0fd0 2026-05-10 17:19:10,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:19:10,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1af9e4d4e78cd76b0fd0 HTTP/1.1" 200 None 2026-05-10 17:19:10,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:19:10,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:19:10,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:19:10,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1af9e4d4e78cd76b0fd0 HTTP/1.1" 200 None 2026-05-10 17:19:10,999 - lava_callback - ERROR - Error processing callback for node 69fe1af9e4d4e78cd76b0fd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:20:16,615 - lava_callback - INFO - Received callback for node 6a00b67c379c7180ed78630e INFO: 172.21.0.1:33584 - "POST /node/6a00b67c379c7180ed78630e HTTP/1.0" 202 Accepted 2026-05-10 17:20:16,621 - lava_callback - INFO - Starting async job submit for node 6a00b67c379c7180ed78630e 2026-05-10 17:20:16,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:16,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b67c379c7180ed78630e HTTP/1.1" 200 None 2026-05-10 17:20:16,666 - lava_callback - DEBUG - Processing node 6a00b67c379c7180ed78630e: ltp-watchqueue 2026-05-10 17:20:17,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:20:17,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:20:17,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-6a00b67c379c7180ed78630e/log.txt.gz 2026-05-10 17:20:17,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:20:17,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:20:17,495 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-6a00b67c379c7180ed78630e/lava-logs.yaml 2026-05-10 17:20:17,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:20:17,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:20:17,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-6a00b67c379c7180ed78630e/lava_callback.json.gz 2026-05-10 17:20:17,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:17,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b67c379c7180ed78630e HTTP/1.1" 200 None 2026-05-10 17:20:17,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:17,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:20:17,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:17,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b67c379c7180ed78630e HTTP/1.1" 200 None 2026-05-10 17:20:17,691 - lava_callback - INFO - Completed processing callback for node 6a00b67c379c7180ed78630e 2026-05-10 17:20:18,055 - lava_callback - INFO - Received callback for node 6a00b67a379c7180ed786309 INFO: 172.21.0.1:33598 - "POST /node/6a00b67a379c7180ed786309 HTTP/1.0" 202 Accepted 2026-05-10 17:20:18,062 - lava_callback - INFO - Starting async job submit for node 6a00b67a379c7180ed786309 2026-05-10 17:20:18,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:18,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b67a379c7180ed786309 HTTP/1.1" 200 None 2026-05-10 17:20:18,116 - lava_callback - DEBUG - Processing node 6a00b67a379c7180ed786309: ltp-timers 2026-05-10 17:20:18,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:20:18,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:20:18,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-6a00b67a379c7180ed786309/log.txt.gz 2026-05-10 17:20:18,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:20:19,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:20:19,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-6a00b67a379c7180ed786309/lava-logs.yaml 2026-05-10 17:20:19,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:20:19,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:20:19,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-6a00b67a379c7180ed786309/lava_callback.json.gz 2026-05-10 17:20:19,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:19,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b67a379c7180ed786309 HTTP/1.1" 200 None 2026-05-10 17:20:19,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:19,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:20:19,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:19,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b67a379c7180ed786309 HTTP/1.1" 200 None 2026-05-10 17:20:19,257 - lava_callback - INFO - Completed processing callback for node 6a00b67a379c7180ed786309 2026-05-10 17:20:19,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:20:19,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:21:51,021 - lava_callback - INFO - Received callback for node 69fe1b9ae4d4e78cd76b1031 INFO: 172.21.0.1:45806 - "POST /node/69fe1b9ae4d4e78cd76b1031 HTTP/1.0" 202 Accepted 2026-05-10 17:21:51,027 - lava_callback - INFO - Starting async job submit for node 69fe1b9ae4d4e78cd76b1031 2026-05-10 17:21:51,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:21:51,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1b9ae4d4e78cd76b1031 HTTP/1.1" 200 None 2026-05-10 17:21:51,042 - lava_callback - DEBUG - Processing node 69fe1b9ae4d4e78cd76b1031: baseline-arm64-clabbe 2026-05-10 17:21:51,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1b9ae4d4e78cd76b1031 2026-05-10 17:21:51,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:21:51,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1b9ae4d4e78cd76b1031 HTTP/1.1" 200 None 2026-05-10 17:21:51,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:21:51,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:21:51,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:21:51,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1b9ae4d4e78cd76b1031 HTTP/1.1" 200 None 2026-05-10 17:21:51,124 - lava_callback - ERROR - Error processing callback for node 69fe1b9ae4d4e78cd76b1031: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:22:17,264 - lava_callback - INFO - Received callback for node 6a00beb6379c7180ed7869d1 INFO: 172.21.0.1:48130 - "POST /node/6a00beb6379c7180ed7869d1 HTTP/1.0" 202 Accepted 2026-05-10 17:22:17,270 - lava_callback - INFO - Starting async job submit for node 6a00beb6379c7180ed7869d1 2026-05-10 17:22:17,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:22:17,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00beb6379c7180ed7869d1 HTTP/1.1" 200 None 2026-05-10 17:22:17,287 - lava_callback - DEBUG - Processing node 6a00beb6379c7180ed7869d1: baseline-nfs-arm64 2026-05-10 17:22:17,289 - lava_callback - WARNING - Failed to upload log 2026-05-10 17:22:17,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:22:17,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:22:17,369 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00beb6379c7180ed7869d1/lava-logs.yaml 2026-05-10 17:22:17,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:22:17,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:22:17,443 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00beb6379c7180ed7869d1/lava_callback.json.gz 2026-05-10 17:22:17,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:22:17,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00beb6379c7180ed7869d1 HTTP/1.1" 200 None 2026-05-10 17:22:17,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:22:17,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:22:17,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:22:17,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00beb6379c7180ed7869d1 HTTP/1.1" 200 None 2026-05-10 17:22:17,494 - lava_callback - INFO - Completed processing callback for node 6a00beb6379c7180ed7869d1 2026-05-10 17:22:19,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:22:19,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:23:11,063 - lava_callback - INFO - Received callback for node 69fe1befe4d4e78cd76b1060 INFO: 172.21.0.1:42808 - "POST /node/69fe1befe4d4e78cd76b1060 HTTP/1.0" 202 Accepted 2026-05-10 17:23:11,069 - lava_callback - INFO - Starting async job submit for node 69fe1befe4d4e78cd76b1060 2026-05-10 17:23:11,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:23:11,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1befe4d4e78cd76b1060 HTTP/1.1" 200 None 2026-05-10 17:23:11,086 - lava_callback - DEBUG - Processing node 69fe1befe4d4e78cd76b1060: baseline-arm64-clabbe 2026-05-10 17:23:11,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1befe4d4e78cd76b1060 2026-05-10 17:23:11,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:23:11,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1befe4d4e78cd76b1060 HTTP/1.1" 200 None 2026-05-10 17:23:11,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:23:11,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:23:11,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:23:11,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1befe4d4e78cd76b1060 HTTP/1.1" 200 None 2026-05-10 17:23:11,134 - lava_callback - ERROR - Error processing callback for node 69fe1befe4d4e78cd76b1060: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 17:24:16,070 - lava_callback - INFO - Received callback for node 6a00b64f379c7180ed7862aa INFO: 172.21.0.1:53304 - "POST /node/6a00b64f379c7180ed7862aa HTTP/1.0" 202 Accepted 2026-05-10 17:24:16,121 - lava_callback - INFO - Starting async job submit for node 6a00b64f379c7180ed7862aa 2026-05-10 17:24:16,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:16,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b64f379c7180ed7862aa HTTP/1.1" 200 None 2026-05-10 17:24:16,159 - lava_callback - DEBUG - Processing node 6a00b64f379c7180ed7862aa: baseline-arm-pengutronix 2026-05-10 17:24:16,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:24:16,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:24:16,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64f379c7180ed7862aa/log.txt.gz 2026-05-10 17:24:16,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:24:16,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:24:16,535 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64f379c7180ed7862aa/lava-logs.yaml 2026-05-10 17:24:16,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:24:16,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:24:16,617 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00b64f379c7180ed7862aa/lava_callback.json.gz DEBUG: Setup failed for 6a00b64f379c7180ed7862aa. Transitting job node result: incomplete -> fail 2026-05-10 17:24:16,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:16,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00b64f379c7180ed7862aa HTTP/1.1" 200 None 2026-05-10 17:24:16,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:16,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:24:16,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:16,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00b64f379c7180ed7862aa HTTP/1.1" 200 None 2026-05-10 17:24:16,776 - lava_callback - INFO - Completed processing callback for node 6a00b64f379c7180ed7862aa 2026-05-10 17:24:19,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:19,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:24:31,129 - lava_callback - INFO - Received callback for node 69fe1c44e4d4e78cd76b108c INFO: 172.21.0.1:48758 - "POST /node/69fe1c44e4d4e78cd76b108c HTTP/1.0" 202 Accepted 2026-05-10 17:24:31,135 - lava_callback - INFO - Starting async job submit for node 69fe1c44e4d4e78cd76b108c 2026-05-10 17:24:31,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:31,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1c44e4d4e78cd76b108c HTTP/1.1" 200 None 2026-05-10 17:24:31,149 - lava_callback - DEBUG - Processing node 69fe1c44e4d4e78cd76b108c: baseline-arm64-clabbe 2026-05-10 17:24:31,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1c44e4d4e78cd76b108c 2026-05-10 17:24:31,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:31,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1c44e4d4e78cd76b108c HTTP/1.1" 200 None 2026-05-10 17:24:31,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:31,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-10 17:24:31,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:31,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1c44e4d4e78cd76b108c HTTP/1.1" 200 None 2026-05-10 17:24:31,193 - lava_callback - ERROR - Error processing callback for node 69fe1c44e4d4e78cd76b108c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:24:49,648 - lava_callback - INFO - Received callback for node 6a00bf13379c7180ed7869fe INFO: 172.21.0.1:53592 - "POST /node/6a00bf13379c7180ed7869fe HTTP/1.0" 202 Accepted 2026-05-10 17:24:49,656 - lava_callback - INFO - Starting async job submit for node 6a00bf13379c7180ed7869fe 2026-05-10 17:24:49,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:49,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bf13379c7180ed7869fe HTTP/1.1" 200 None 2026-05-10 17:24:49,714 - lava_callback - DEBUG - Processing node 6a00bf13379c7180ed7869fe: baseline-arm64-foundriesio 2026-05-10 17:24:50,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:24:50,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:24:50,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00bf13379c7180ed7869fe/log.txt.gz 2026-05-10 17:24:50,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:24:50,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:24:50,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00bf13379c7180ed7869fe/lava-logs.yaml 2026-05-10 17:24:50,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:24:50,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:24:50,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a00bf13379c7180ed7869fe/lava_callback.json.gz 2026-05-10 17:24:50,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:50,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bf13379c7180ed7869fe HTTP/1.1" 200 None 2026-05-10 17:24:50,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:50,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:24:50,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:24:50,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bf13379c7180ed7869fe HTTP/1.1" 200 None 2026-05-10 17:24:50,978 - lava_callback - INFO - Completed processing callback for node 6a00bf13379c7180ed7869fe INFO: 172.21.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:25:19,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:25:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 17:25:20,577 - lava_callback - INFO - Received callback for node 6a00bf49379c7180ed786a18 INFO: 172.21.0.1:36794 - "POST /node/6a00bf49379c7180ed786a18 HTTP/1.0" 202 Accepted 2026-05-10 17:25:20,584 - lava_callback - INFO - Starting async job submit for node 6a00bf49379c7180ed786a18 2026-05-10 17:25:20,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:25:20,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bf49379c7180ed786a18 HTTP/1.1" 200 None 2026-05-10 17:25:20,628 - lava_callback - DEBUG - Processing node 6a00bf49379c7180ed786a18: baseline-arm64 2026-05-10 17:25:20,771 - lava_callback - WARNING - Failed to upload log 2026-05-10 17:25:20,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:25:20,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:25:20,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bf49379c7180ed786a18/lava-logs.yaml 2026-05-10 17:25:20,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:25:21,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:25:21,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00bf49379c7180ed786a18/lava_callback.json.gz 2026-05-10 17:25:21,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:25:21,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bf49379c7180ed786a18 HTTP/1.1" 200 None 2026-05-10 17:25:21,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:25:21,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:25:21,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:25:21,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bf49379c7180ed786a18 HTTP/1.1" 200 None 2026-05-10 17:25:21,178 - lava_callback - INFO - Completed processing callback for node 6a00bf49379c7180ed786a18 INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:25:49,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:25:49,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39940 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:26:31,018 - lava_callback - INFO - Received callback for node 69fe1cbfe4d4e78cd76b10b8 INFO: 172.21.0.1:36156 - "POST /node/69fe1cbfe4d4e78cd76b10b8 HTTP/1.0" 202 Accepted 2026-05-10 17:26:31,024 - lava_callback - INFO - Starting async job submit for node 69fe1cbfe4d4e78cd76b10b8 2026-05-10 17:26:31,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:26:31,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1cbfe4d4e78cd76b10b8 HTTP/1.1" 200 None 2026-05-10 17:26:31,039 - lava_callback - DEBUG - Processing node 69fe1cbfe4d4e78cd76b10b8: baseline-arm-baylibre 2026-05-10 17:26:31,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1cbfe4d4e78cd76b10b8 2026-05-10 17:26:31,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:26:31,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1cbfe4d4e78cd76b10b8 HTTP/1.1" 200 None 2026-05-10 17:26:31,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:26:31,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:26:31,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:26:31,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1cbfe4d4e78cd76b10b8 HTTP/1.1" 200 None 2026-05-10 17:26:31,090 - lava_callback - ERROR - Error processing callback for node 69fe1cbfe4d4e78cd76b10b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:27:10,991 - lava_callback - INFO - Received callback for node 69fe1cebe4d4e78cd76b10cf INFO: 172.21.0.1:33470 - "POST /node/69fe1cebe4d4e78cd76b10cf HTTP/1.0" 202 Accepted 2026-05-10 17:27:10,997 - lava_callback - INFO - Starting async job submit for node 69fe1cebe4d4e78cd76b10cf 2026-05-10 17:27:10,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:27:11,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1cebe4d4e78cd76b10cf HTTP/1.1" 200 None 2026-05-10 17:27:11,024 - lava_callback - DEBUG - Processing node 69fe1cebe4d4e78cd76b10cf: baseline-arm-baylibre 2026-05-10 17:27:11,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1cebe4d4e78cd76b10cf 2026-05-10 17:27:11,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:27:11,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1cebe4d4e78cd76b10cf HTTP/1.1" 200 None 2026-05-10 17:27:11,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:27:11,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:27:11,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:27:11,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1cebe4d4e78cd76b10cf HTTP/1.1" 200 None 2026-05-10 17:27:11,081 - lava_callback - ERROR - Error processing callback for node 69fe1cebe4d4e78cd76b10cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:27:51,085 - lava_callback - INFO - Received callback for node 69fe1d14e4d4e78cd76b10f0 INFO: 172.21.0.1:48712 - "POST /node/69fe1d14e4d4e78cd76b10f0 HTTP/1.0" 202 Accepted 2026-05-10 17:27:51,090 - lava_callback - INFO - Starting async job submit for node 69fe1d14e4d4e78cd76b10f0 2026-05-10 17:27:51,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:27:51,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1d14e4d4e78cd76b10f0 HTTP/1.1" 200 None 2026-05-10 17:27:51,147 - lava_callback - DEBUG - Processing node 69fe1d14e4d4e78cd76b10f0: baseline-arm-baylibre 2026-05-10 17:27:51,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1d14e4d4e78cd76b10f0 2026-05-10 17:27:51,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:27:51,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1d14e4d4e78cd76b10f0 HTTP/1.1" 200 None 2026-05-10 17:27:51,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:27:51,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:27:51,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:27:51,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1d14e4d4e78cd76b10f0 HTTP/1.1" 200 None 2026-05-10 17:27:51,248 - lava_callback - ERROR - Error processing callback for node 69fe1d14e4d4e78cd76b10f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:29:31,193 - lava_callback - INFO - Received callback for node 69fe1d77e4d4e78cd76b1114 INFO: 172.21.0.1:50182 - "POST /node/69fe1d77e4d4e78cd76b1114 HTTP/1.0" 202 Accepted 2026-05-10 17:29:31,199 - lava_callback - INFO - Starting async job submit for node 69fe1d77e4d4e78cd76b1114 2026-05-10 17:29:31,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:29:31,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1d77e4d4e78cd76b1114 HTTP/1.1" 200 None 2026-05-10 17:29:31,226 - lava_callback - DEBUG - Processing node 69fe1d77e4d4e78cd76b1114: baseline-arm-baylibre 2026-05-10 17:29:31,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1d77e4d4e78cd76b1114 2026-05-10 17:29:31,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:29:31,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1d77e4d4e78cd76b1114 HTTP/1.1" 200 None 2026-05-10 17:29:31,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:29:31,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:29:31,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:29:31,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1d77e4d4e78cd76b1114 HTTP/1.1" 200 None 2026-05-10 17:29:31,272 - lava_callback - ERROR - Error processing callback for node 69fe1d77e4d4e78cd76b1114: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:30:11,177 - lava_callback - INFO - Received callback for node 69fe1da1e4d4e78cd76b112a INFO: 172.21.0.1:33236 - "POST /node/69fe1da1e4d4e78cd76b112a HTTP/1.0" 202 Accepted 2026-05-10 17:30:11,183 - lava_callback - INFO - Starting async job submit for node 69fe1da1e4d4e78cd76b112a 2026-05-10 17:30:11,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:30:11,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1da1e4d4e78cd76b112a HTTP/1.1" 200 None 2026-05-10 17:30:11,204 - lava_callback - DEBUG - Processing node 69fe1da1e4d4e78cd76b112a: baseline-arm-baylibre 2026-05-10 17:30:11,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1da1e4d4e78cd76b112a 2026-05-10 17:30:11,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:30:11,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1da1e4d4e78cd76b112a HTTP/1.1" 200 None 2026-05-10 17:30:11,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:30:11,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:30:11,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:30:11,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1da1e4d4e78cd76b112a HTTP/1.1" 200 None 2026-05-10 17:30:11,252 - lava_callback - ERROR - Error processing callback for node 69fe1da1e4d4e78cd76b112a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:30:51,307 - lava_callback - INFO - Received callback for node 69fe1dc9e4d4e78cd76b1144 INFO: 172.21.0.1:42928 - "POST /node/69fe1dc9e4d4e78cd76b1144 HTTP/1.0" 202 Accepted 2026-05-10 17:30:51,313 - lava_callback - INFO - Starting async job submit for node 69fe1dc9e4d4e78cd76b1144 2026-05-10 17:30:51,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:30:51,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1dc9e4d4e78cd76b1144 HTTP/1.1" 200 None 2026-05-10 17:30:51,331 - lava_callback - DEBUG - Processing node 69fe1dc9e4d4e78cd76b1144: baseline-arm-baylibre 2026-05-10 17:30:51,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1dc9e4d4e78cd76b1144 2026-05-10 17:30:51,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:30:51,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1dc9e4d4e78cd76b1144 HTTP/1.1" 200 None 2026-05-10 17:30:51,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:30:51,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:30:51,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:30:51,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1dc9e4d4e78cd76b1144 HTTP/1.1" 200 None 2026-05-10 17:30:51,392 - lava_callback - ERROR - Error processing callback for node 69fe1dc9e4d4e78cd76b1144: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET /node/69f3224893551c40ae2f6a20%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:31:51,486 - lava_callback - INFO - Received callback for node 69fe1df2e4d4e78cd76b115a INFO: 172.21.0.1:58208 - "POST /node/69fe1df2e4d4e78cd76b115a HTTP/1.0" 202 Accepted 2026-05-10 17:31:51,491 - lava_callback - INFO - Starting async job submit for node 69fe1df2e4d4e78cd76b115a 2026-05-10 17:31:51,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:31:51,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1df2e4d4e78cd76b115a HTTP/1.1" 200 None 2026-05-10 17:31:51,507 - lava_callback - DEBUG - Processing node 69fe1df2e4d4e78cd76b115a: baseline-arm-clabbe 2026-05-10 17:31:51,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1df2e4d4e78cd76b115a 2026-05-10 17:31:51,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:31:51,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1df2e4d4e78cd76b115a HTTP/1.1" 200 None 2026-05-10 17:31:51,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:31:51,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:31:51,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:31:51,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1df2e4d4e78cd76b115a HTTP/1.1" 200 None 2026-05-10 17:31:51,554 - lava_callback - ERROR - Error processing callback for node 69fe1df2e4d4e78cd76b115a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:32:31,462 - lava_callback - INFO - Received callback for node 69fe1e1be4d4e78cd76b1173 INFO: 172.21.0.1:42434 - "POST /node/69fe1e1be4d4e78cd76b1173 HTTP/1.0" 202 Accepted 2026-05-10 17:32:31,468 - lava_callback - INFO - Starting async job submit for node 69fe1e1be4d4e78cd76b1173 2026-05-10 17:32:31,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:32:31,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1e1be4d4e78cd76b1173 HTTP/1.1" 200 None 2026-05-10 17:32:31,484 - lava_callback - DEBUG - Processing node 69fe1e1be4d4e78cd76b1173: baseline-arm-clabbe 2026-05-10 17:32:31,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1e1be4d4e78cd76b1173 2026-05-10 17:32:31,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:32:31,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1e1be4d4e78cd76b1173 HTTP/1.1" 200 None 2026-05-10 17:32:31,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:32:31,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:32:31,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:32:31,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1e1be4d4e78cd76b1173 HTTP/1.1" 200 None 2026-05-10 17:32:31,543 - lava_callback - ERROR - Error processing callback for node 69fe1e1be4d4e78cd76b1173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:32:51,493 - lava_callback - INFO - Received callback for node 69fe1e3ee4d4e78cd76b1187 INFO: 172.21.0.1:59216 - "POST /node/69fe1e3ee4d4e78cd76b1187 HTTP/1.0" 202 Accepted 2026-05-10 17:32:51,498 - lava_callback - INFO - Starting async job submit for node 69fe1e3ee4d4e78cd76b1187 2026-05-10 17:32:51,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:32:51,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1e3ee4d4e78cd76b1187 HTTP/1.1" 200 None 2026-05-10 17:32:51,519 - lava_callback - DEBUG - Processing node 69fe1e3ee4d4e78cd76b1187: baseline-arm-baylibre 2026-05-10 17:32:51,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1e3ee4d4e78cd76b1187 2026-05-10 17:32:51,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:32:51,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1e3ee4d4e78cd76b1187 HTTP/1.1" 200 None 2026-05-10 17:32:51,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:32:51,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:32:51,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:32:51,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1e3ee4d4e78cd76b1187 HTTP/1.1" 200 None 2026-05-10 17:32:51,579 - lava_callback - ERROR - Error processing callback for node 69fe1e3ee4d4e78cd76b1187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:33:31,370 - lava_callback - INFO - Received callback for node 69fe1e66e4d4e78cd76b119f INFO: 172.21.0.1:39876 - "POST /node/69fe1e66e4d4e78cd76b119f HTTP/1.0" 202 Accepted 2026-05-10 17:33:31,375 - lava_callback - INFO - Starting async job submit for node 69fe1e66e4d4e78cd76b119f 2026-05-10 17:33:31,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:33:31,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1e66e4d4e78cd76b119f HTTP/1.1" 200 None 2026-05-10 17:33:31,391 - lava_callback - DEBUG - Processing node 69fe1e66e4d4e78cd76b119f: baseline-arm-baylibre 2026-05-10 17:33:31,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1e66e4d4e78cd76b119f 2026-05-10 17:33:31,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:33:31,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1e66e4d4e78cd76b119f HTTP/1.1" 200 None 2026-05-10 17:33:31,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:33:31,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:33:31,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:33:31,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1e66e4d4e78cd76b119f HTTP/1.1" 200 None 2026-05-10 17:33:31,435 - lava_callback - ERROR - Error processing callback for node 69fe1e66e4d4e78cd76b119f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:34:26,017 - lava_callback - INFO - Received callback for node 6a00bd60379c7180ed786920 INFO: 172.21.0.1:55430 - "POST /node/6a00bd60379c7180ed786920 HTTP/1.0" 202 Accepted 2026-05-10 17:34:26,024 - lava_callback - INFO - Starting async job submit for node 6a00bd60379c7180ed786920 2026-05-10 17:34:26,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:26,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bd60379c7180ed786920 HTTP/1.1" 200 None 2026-05-10 17:34:26,100 - lava_callback - DEBUG - Processing node 6a00bd60379c7180ed786920: baseline-arm INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:34:26,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:34:26,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:34:26,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00bd60379c7180ed786920/log.txt.gz 2026-05-10 17:34:27,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:34:27,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:34:27,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00bd60379c7180ed786920/lava-logs.yaml 2026-05-10 17:34:27,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:34:27,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:34:27,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00bd60379c7180ed786920/lava_callback.json.gz DEBUG: Setup failed for 6a00bd60379c7180ed786920. Transitting job node result: incomplete -> fail 2026-05-10 17:34:28,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:28,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00bd60379c7180ed786920 HTTP/1.1" 200 None 2026-05-10 17:34:28,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:28,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 17:34:28,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:28,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00bd60379c7180ed786920 HTTP/1.1" 200 None 2026-05-10 17:34:28,195 - lava_callback - INFO - Completed processing callback for node 6a00bd60379c7180ed786920 INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:34:49,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:49,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 17:34:51,486 - lava_callback - INFO - Received callback for node 69fe1eb5e4d4e78cd76b11cb INFO: 172.21.0.1:43596 - "POST /node/69fe1eb5e4d4e78cd76b11cb HTTP/1.0" 202 Accepted 2026-05-10 17:34:51,491 - lava_callback - INFO - Starting async job submit for node 69fe1eb5e4d4e78cd76b11cb 2026-05-10 17:34:51,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:51,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1eb5e4d4e78cd76b11cb HTTP/1.1" 200 None 2026-05-10 17:34:51,506 - lava_callback - DEBUG - Processing node 69fe1eb5e4d4e78cd76b11cb: baseline-arm-baylibre 2026-05-10 17:34:51,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1eb5e4d4e78cd76b11cb 2026-05-10 17:34:51,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:51,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1eb5e4d4e78cd76b11cb HTTP/1.1" 200 None 2026-05-10 17:34:51,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:51,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:34:51,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:34:51,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1eb5e4d4e78cd76b11cb HTTP/1.1" 200 None 2026-05-10 17:34:51,552 - lava_callback - ERROR - Error processing callback for node 69fe1eb5e4d4e78cd76b11cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:35:31,454 - lava_callback - INFO - Received callback for node 69fe1edce4d4e78cd76b11e1 INFO: 172.21.0.1:47948 - "POST /node/69fe1edce4d4e78cd76b11e1 HTTP/1.0" 202 Accepted 2026-05-10 17:35:31,461 - lava_callback - INFO - Starting async job submit for node 69fe1edce4d4e78cd76b11e1 2026-05-10 17:35:31,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:35:31,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1edce4d4e78cd76b11e1 HTTP/1.1" 200 None 2026-05-10 17:35:31,478 - lava_callback - DEBUG - Processing node 69fe1edce4d4e78cd76b11e1: baseline-arm-baylibre 2026-05-10 17:35:31,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1edce4d4e78cd76b11e1 2026-05-10 17:35:31,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:35:31,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1edce4d4e78cd76b11e1 HTTP/1.1" 200 None 2026-05-10 17:35:31,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:35:31,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:35:31,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:35:31,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1edce4d4e78cd76b11e1 HTTP/1.1" 200 None 2026-05-10 17:35:31,546 - lava_callback - ERROR - Error processing callback for node 69fe1edce4d4e78cd76b11e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:36:11,535 - lava_callback - INFO - Received callback for node 69fe1f04e4d4e78cd76b11f0 INFO: 172.21.0.1:35908 - "POST /node/69fe1f04e4d4e78cd76b11f0 HTTP/1.0" 202 Accepted 2026-05-10 17:36:11,541 - lava_callback - INFO - Starting async job submit for node 69fe1f04e4d4e78cd76b11f0 2026-05-10 17:36:11,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:36:11,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1f04e4d4e78cd76b11f0 HTTP/1.1" 200 None 2026-05-10 17:36:11,564 - lava_callback - DEBUG - Processing node 69fe1f04e4d4e78cd76b11f0: baseline-arm-baylibre 2026-05-10 17:36:11,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1f04e4d4e78cd76b11f0 2026-05-10 17:36:11,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:36:11,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1f04e4d4e78cd76b11f0 HTTP/1.1" 200 None 2026-05-10 17:36:11,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:36:11,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:36:11,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:36:11,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1f04e4d4e78cd76b11f0 HTTP/1.1" 200 None 2026-05-10 17:36:11,610 - lava_callback - ERROR - Error processing callback for node 69fe1f04e4d4e78cd76b11f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET /node/69402a6f575bc060ce155107%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:37:31,727 - lava_callback - INFO - Received callback for node 69fe1f55e4d4e78cd76b121f INFO: 172.21.0.1:50854 - "POST /node/69fe1f55e4d4e78cd76b121f HTTP/1.0" 202 Accepted 2026-05-10 17:37:31,733 - lava_callback - INFO - Starting async job submit for node 69fe1f55e4d4e78cd76b121f 2026-05-10 17:37:31,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:37:31,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1f55e4d4e78cd76b121f HTTP/1.1" 200 None 2026-05-10 17:37:31,748 - lava_callback - DEBUG - Processing node 69fe1f55e4d4e78cd76b121f: baseline-arm-clabbe 2026-05-10 17:37:31,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1f55e4d4e78cd76b121f 2026-05-10 17:37:31,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:37:31,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1f55e4d4e78cd76b121f HTTP/1.1" 200 None 2026-05-10 17:37:31,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:37:31,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:37:31,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:37:31,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1f55e4d4e78cd76b121f HTTP/1.1" 200 None 2026-05-10 17:37:31,805 - lava_callback - ERROR - Error processing callback for node 69fe1f55e4d4e78cd76b121f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:38:11,693 - lava_callback - INFO - Received callback for node 69fe1f7be4d4e78cd76b123e INFO: 172.21.0.1:51122 - "POST /node/69fe1f7be4d4e78cd76b123e HTTP/1.0" 202 Accepted 2026-05-10 17:38:11,699 - lava_callback - INFO - Starting async job submit for node 69fe1f7be4d4e78cd76b123e 2026-05-10 17:38:11,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:38:11,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1f7be4d4e78cd76b123e HTTP/1.1" 200 None 2026-05-10 17:38:11,714 - lava_callback - DEBUG - Processing node 69fe1f7be4d4e78cd76b123e: baseline-arm-baylibre 2026-05-10 17:38:11,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1f7be4d4e78cd76b123e 2026-05-10 17:38:11,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:38:11,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1f7be4d4e78cd76b123e HTTP/1.1" 200 None 2026-05-10 17:38:11,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:38:11,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:38:11,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:38:11,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1f7be4d4e78cd76b123e HTTP/1.1" 200 None 2026-05-10 17:38:11,762 - lava_callback - ERROR - Error processing callback for node 69fe1f7be4d4e78cd76b123e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:38:51,797 - lava_callback - INFO - Received callback for node 69fe1fa5e4d4e78cd76b126a INFO: 172.21.0.1:54170 - "POST /node/69fe1fa5e4d4e78cd76b126a HTTP/1.0" 202 Accepted 2026-05-10 17:38:51,803 - lava_callback - INFO - Starting async job submit for node 69fe1fa5e4d4e78cd76b126a 2026-05-10 17:38:51,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:38:51,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1fa5e4d4e78cd76b126a HTTP/1.1" 200 None 2026-05-10 17:38:51,827 - lava_callback - DEBUG - Processing node 69fe1fa5e4d4e78cd76b126a: baseline-arm-clabbe 2026-05-10 17:38:51,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1fa5e4d4e78cd76b126a 2026-05-10 17:38:51,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:38:51,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1fa5e4d4e78cd76b126a HTTP/1.1" 200 None 2026-05-10 17:38:51,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:38:51,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:38:51,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:38:51,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1fa5e4d4e78cd76b126a HTTP/1.1" 200 None 2026-05-10 17:38:51,888 - lava_callback - ERROR - Error processing callback for node 69fe1fa5e4d4e78cd76b126a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:39:31,781 - lava_callback - INFO - Received callback for node 69fe1fcde4d4e78cd76b127e INFO: 172.21.0.1:41686 - "POST /node/69fe1fcde4d4e78cd76b127e HTTP/1.0" 202 Accepted 2026-05-10 17:39:31,787 - lava_callback - INFO - Starting async job submit for node 69fe1fcde4d4e78cd76b127e 2026-05-10 17:39:31,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:39:31,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1fcde4d4e78cd76b127e HTTP/1.1" 200 None 2026-05-10 17:39:31,802 - lava_callback - DEBUG - Processing node 69fe1fcde4d4e78cd76b127e: baseline-arm-clabbe 2026-05-10 17:39:31,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1fcde4d4e78cd76b127e 2026-05-10 17:39:31,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:39:31,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1fcde4d4e78cd76b127e HTTP/1.1" 200 None 2026-05-10 17:39:31,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:39:31,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:39:31,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:39:31,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1fcde4d4e78cd76b127e HTTP/1.1" 200 None 2026-05-10 17:39:31,848 - lava_callback - ERROR - Error processing callback for node 69fe1fcde4d4e78cd76b127e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:40:11,891 - lava_callback - INFO - Received callback for node 69fe1ff6e4d4e78cd76b1290 INFO: 172.21.0.1:49338 - "POST /node/69fe1ff6e4d4e78cd76b1290 HTTP/1.0" 202 Accepted 2026-05-10 17:40:11,899 - lava_callback - INFO - Starting async job submit for node 69fe1ff6e4d4e78cd76b1290 2026-05-10 17:40:11,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:40:11,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1ff6e4d4e78cd76b1290 HTTP/1.1" 200 None 2026-05-10 17:40:11,914 - lava_callback - DEBUG - Processing node 69fe1ff6e4d4e78cd76b1290: baseline-arm-clabbe 2026-05-10 17:40:11,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe1ff6e4d4e78cd76b1290 2026-05-10 17:40:11,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:40:11,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe1ff6e4d4e78cd76b1290 HTTP/1.1" 200 None 2026-05-10 17:40:11,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:40:11,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:40:11,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:40:11,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe1ff6e4d4e78cd76b1290 HTTP/1.1" 200 None 2026-05-10 17:40:11,972 - lava_callback - ERROR - Error processing callback for node 69fe1ff6e4d4e78cd76b1290: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:40:51,830 - lava_callback - INFO - Received callback for node 69fe201ee4d4e78cd76b12aa INFO: 172.21.0.1:46328 - "POST /node/69fe201ee4d4e78cd76b12aa HTTP/1.0" 202 Accepted 2026-05-10 17:40:51,837 - lava_callback - INFO - Starting async job submit for node 69fe201ee4d4e78cd76b12aa 2026-05-10 17:40:51,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:40:51,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe201ee4d4e78cd76b12aa HTTP/1.1" 200 None 2026-05-10 17:40:51,852 - lava_callback - DEBUG - Processing node 69fe201ee4d4e78cd76b12aa: baseline-arm-clabbe 2026-05-10 17:40:51,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe201ee4d4e78cd76b12aa 2026-05-10 17:40:51,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:40:51,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe201ee4d4e78cd76b12aa HTTP/1.1" 200 None 2026-05-10 17:40:51,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:40:51,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:40:51,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:40:51,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe201ee4d4e78cd76b12aa HTTP/1.1" 200 None 2026-05-10 17:40:51,897 - lava_callback - ERROR - Error processing callback for node 69fe201ee4d4e78cd76b12aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:41:32,131 - lava_callback - INFO - Received callback for node 69fe2046e4d4e78cd76b12bc INFO: 172.21.0.1:46264 - "POST /node/69fe2046e4d4e78cd76b12bc HTTP/1.0" 202 Accepted 2026-05-10 17:41:32,137 - lava_callback - INFO - Starting async job submit for node 69fe2046e4d4e78cd76b12bc 2026-05-10 17:41:32,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:41:32,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2046e4d4e78cd76b12bc HTTP/1.1" 200 None 2026-05-10 17:41:32,152 - lava_callback - DEBUG - Processing node 69fe2046e4d4e78cd76b12bc: baseline-arm-clabbe 2026-05-10 17:41:32,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2046e4d4e78cd76b12bc 2026-05-10 17:41:32,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:41:32,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2046e4d4e78cd76b12bc HTTP/1.1" 200 None 2026-05-10 17:41:32,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:41:32,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:41:32,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:41:32,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2046e4d4e78cd76b12bc HTTP/1.1" 200 None 2026-05-10 17:41:32,199 - lava_callback - ERROR - Error processing callback for node 69fe2046e4d4e78cd76b12bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:42:11,853 - lava_callback - INFO - Received callback for node 69fe206de4d4e78cd76b12d0 INFO: 172.21.0.1:55876 - "POST /node/69fe206de4d4e78cd76b12d0 HTTP/1.0" 202 Accepted 2026-05-10 17:42:11,859 - lava_callback - INFO - Starting async job submit for node 69fe206de4d4e78cd76b12d0 2026-05-10 17:42:11,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:42:11,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe206de4d4e78cd76b12d0 HTTP/1.1" 200 None 2026-05-10 17:42:11,880 - lava_callback - DEBUG - Processing node 69fe206de4d4e78cd76b12d0: baseline-arm-clabbe 2026-05-10 17:42:11,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe206de4d4e78cd76b12d0 2026-05-10 17:42:11,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:42:11,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe206de4d4e78cd76b12d0 HTTP/1.1" 200 None 2026-05-10 17:42:11,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:42:11,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 17:42:11,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:42:11,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe206de4d4e78cd76b12d0 HTTP/1.1" 200 None 2026-05-10 17:42:11,927 - lava_callback - ERROR - Error processing callback for node 69fe206de4d4e78cd76b12d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:42:51,966 - lava_callback - INFO - Received callback for node 69fe2095e4d4e78cd76b12e6 INFO: 172.21.0.1:42998 - "POST /node/69fe2095e4d4e78cd76b12e6 HTTP/1.0" 202 Accepted 2026-05-10 17:42:51,971 - lava_callback - INFO - Starting async job submit for node 69fe2095e4d4e78cd76b12e6 2026-05-10 17:42:51,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:42:51,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2095e4d4e78cd76b12e6 HTTP/1.1" 200 None 2026-05-10 17:42:51,989 - lava_callback - DEBUG - Processing node 69fe2095e4d4e78cd76b12e6: baseline-arm-clabbe 2026-05-10 17:42:51,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2095e4d4e78cd76b12e6 2026-05-10 17:42:51,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:42:52,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2095e4d4e78cd76b12e6 HTTP/1.1" 200 None 2026-05-10 17:42:52,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:42:52,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:42:52,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:42:52,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2095e4d4e78cd76b12e6 HTTP/1.1" 200 None 2026-05-10 17:42:52,042 - lava_callback - ERROR - Error processing callback for node 69fe2095e4d4e78cd76b12e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:43:31,896 - lava_callback - INFO - Received callback for node 69fe20bde4d4e78cd76b12f8 INFO: 172.21.0.1:49508 - "POST /node/69fe20bde4d4e78cd76b12f8 HTTP/1.0" 202 Accepted 2026-05-10 17:43:31,902 - lava_callback - INFO - Starting async job submit for node 69fe20bde4d4e78cd76b12f8 2026-05-10 17:43:31,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:43:31,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe20bde4d4e78cd76b12f8 HTTP/1.1" 200 None 2026-05-10 17:43:31,922 - lava_callback - DEBUG - Processing node 69fe20bde4d4e78cd76b12f8: baseline-arm-clabbe 2026-05-10 17:43:31,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe20bde4d4e78cd76b12f8 2026-05-10 17:43:31,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:43:31,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe20bde4d4e78cd76b12f8 HTTP/1.1" 200 None 2026-05-10 17:43:31,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:43:31,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-10 17:43:31,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:43:31,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe20bde4d4e78cd76b12f8 HTTP/1.1" 200 None 2026-05-10 17:43:31,980 - lava_callback - ERROR - Error processing callback for node 69fe20bde4d4e78cd76b12f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:43:53,230 - lava_callback - INFO - Received callback for node 6a00c36c379c7180ed786c31 INFO: 172.21.0.1:38322 - "POST /node/6a00c36c379c7180ed786c31 HTTP/1.0" 202 Accepted 2026-05-10 17:43:53,237 - lava_callback - INFO - Starting async job submit for node 6a00c36c379c7180ed786c31 2026-05-10 17:43:53,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:43:53,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c36c379c7180ed786c31 HTTP/1.1" 200 None 2026-05-10 17:43:53,282 - lava_callback - DEBUG - Processing node 6a00c36c379c7180ed786c31: baseline-arm64 2026-05-10 17:43:53,477 - lava_callback - WARNING - Failed to upload log 2026-05-10 17:43:53,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:43:53,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:43:53,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00c36c379c7180ed786c31/lava-logs.yaml 2026-05-10 17:43:53,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:43:54,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:43:54,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00c36c379c7180ed786c31/lava_callback.json.gz 2026-05-10 17:43:54,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:43:54,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c36c379c7180ed786c31 HTTP/1.1" 200 None 2026-05-10 17:43:54,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:43:54,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:43:54,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:43:54,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c36c379c7180ed786c31 HTTP/1.1" 200 None 2026-05-10 17:43:54,153 - lava_callback - INFO - Completed processing callback for node 6a00c36c379c7180ed786c31 INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32836 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:44:12,003 - lava_callback - INFO - Received callback for node 69fe20eae4d4e78cd76b130a INFO: 172.21.0.1:46794 - "POST /node/69fe20eae4d4e78cd76b130a HTTP/1.0" 202 Accepted 2026-05-10 17:44:12,009 - lava_callback - INFO - Starting async job submit for node 69fe20eae4d4e78cd76b130a 2026-05-10 17:44:12,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:44:12,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe20eae4d4e78cd76b130a HTTP/1.1" 200 None 2026-05-10 17:44:12,031 - lava_callback - DEBUG - Processing node 69fe20eae4d4e78cd76b130a: baseline-arm64-baylibre 2026-05-10 17:44:12,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe20eae4d4e78cd76b130a 2026-05-10 17:44:12,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:44:12,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe20eae4d4e78cd76b130a HTTP/1.1" 200 None 2026-05-10 17:44:12,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:44:12,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 17:44:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:44:12,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe20eae4d4e78cd76b130a HTTP/1.1" 200 None 2026-05-10 17:44:12,128 - lava_callback - ERROR - Error processing callback for node 69fe20eae4d4e78cd76b130a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:44:19,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:44:19,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:46:12,116 - lava_callback - INFO - Received callback for node 69fe215fe4d4e78cd76b1352 INFO: 172.21.0.1:35722 - "POST /node/69fe215fe4d4e78cd76b1352 HTTP/1.0" 202 Accepted 2026-05-10 17:46:12,121 - lava_callback - INFO - Starting async job submit for node 69fe215fe4d4e78cd76b1352 2026-05-10 17:46:12,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:46:12,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe215fe4d4e78cd76b1352 HTTP/1.1" 200 None 2026-05-10 17:46:12,138 - lava_callback - DEBUG - Processing node 69fe215fe4d4e78cd76b1352: baseline-arm64-baylibre 2026-05-10 17:46:12,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe215fe4d4e78cd76b1352 2026-05-10 17:46:12,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:46:12,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe215fe4d4e78cd76b1352 HTTP/1.1" 200 None 2026-05-10 17:46:12,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:46:12,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 17:46:12,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:46:12,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe215fe4d4e78cd76b1352 HTTP/1.1" 200 None 2026-05-10 17:46:12,206 - lava_callback - ERROR - Error processing callback for node 69fe215fe4d4e78cd76b1352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:48:12,254 - lava_callback - INFO - Received callback for node 69fe21d5e4d4e78cd76b138d INFO: 172.21.0.1:37156 - "POST /node/69fe21d5e4d4e78cd76b138d HTTP/1.0" 202 Accepted 2026-05-10 17:48:12,260 - lava_callback - INFO - Starting async job submit for node 69fe21d5e4d4e78cd76b138d 2026-05-10 17:48:12,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:48:12,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe21d5e4d4e78cd76b138d HTTP/1.1" 200 None 2026-05-10 17:48:12,284 - lava_callback - DEBUG - Processing node 69fe21d5e4d4e78cd76b138d: baseline-arm64-baylibre 2026-05-10 17:48:12,284 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe21d5e4d4e78cd76b138d 2026-05-10 17:48:12,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:48:12,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe21d5e4d4e78cd76b138d HTTP/1.1" 200 None 2026-05-10 17:48:12,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:48:12,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 17:48:12,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:48:12,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe21d5e4d4e78cd76b138d HTTP/1.1" 200 None 2026-05-10 17:48:12,338 - lava_callback - ERROR - Error processing callback for node 69fe21d5e4d4e78cd76b138d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:49:08,945 - lava_callback - INFO - Received callback for node 6a00c3be379c7180ed786c58 INFO: 172.21.0.1:54246 - "POST /node/6a00c3be379c7180ed786c58 HTTP/1.0" 202 Accepted 2026-05-10 17:49:08,952 - lava_callback - INFO - Starting async job submit for node 6a00c3be379c7180ed786c58 2026-05-10 17:49:08,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:49:09,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c3be379c7180ed786c58 HTTP/1.1" 200 None 2026-05-10 17:49:09,001 - lava_callback - DEBUG - Processing node 6a00c3be379c7180ed786c58: baseline-arm64 2026-05-10 17:49:09,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:49:09,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:49:09,502 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00c3be379c7180ed786c58/log.txt.gz 2026-05-10 17:49:09,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:49:09,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:49:09,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00c3be379c7180ed786c58/lava-logs.yaml 2026-05-10 17:49:09,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 17:49:10,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 17:49:10,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00c3be379c7180ed786c58/lava_callback.json.gz DEBUG: Setup failed for 6a00c3be379c7180ed786c58. Transitting job node result: incomplete -> fail 2026-05-10 17:49:10,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:49:10,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c3be379c7180ed786c58 HTTP/1.1" 200 None 2026-05-10 17:49:10,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:49:10,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 17:49:10,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:49:10,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c3be379c7180ed786c58 HTTP/1.1" 200 None 2026-05-10 17:49:10,259 - lava_callback - INFO - Completed processing callback for node 6a00c3be379c7180ed786c58 INFO: 172.21.0.1:58798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:49:19,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:49:19,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:52:32,412 - lava_callback - INFO - Received callback for node 69fe22cbe4d4e78cd76b140e INFO: 172.21.0.1:53084 - "POST /node/69fe22cbe4d4e78cd76b140e HTTP/1.0" 202 Accepted 2026-05-10 17:52:32,417 - lava_callback - INFO - Starting async job submit for node 69fe22cbe4d4e78cd76b140e 2026-05-10 17:52:32,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:52:32,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe22cbe4d4e78cd76b140e HTTP/1.1" 200 None 2026-05-10 17:52:32,434 - lava_callback - DEBUG - Processing node 69fe22cbe4d4e78cd76b140e: baseline-arm64-baylibre 2026-05-10 17:52:32,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe22cbe4d4e78cd76b140e 2026-05-10 17:52:32,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:52:32,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe22cbe4d4e78cd76b140e HTTP/1.1" 200 None 2026-05-10 17:52:32,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:52:32,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 17:52:32,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:52:32,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe22cbe4d4e78cd76b140e HTTP/1.1" 200 None 2026-05-10 17:52:32,491 - lava_callback - ERROR - Error processing callback for node 69fe22cbe4d4e78cd76b140e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54144 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:57:12,903 - lava_callback - INFO - Received callback for node 69fe23eae4d4e78cd76b14aa INFO: 172.21.0.1:41582 - "POST /node/69fe23eae4d4e78cd76b14aa HTTP/1.0" 202 Accepted 2026-05-10 17:57:12,909 - lava_callback - INFO - Starting async job submit for node 69fe23eae4d4e78cd76b14aa 2026-05-10 17:57:12,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:57:12,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe23eae4d4e78cd76b14aa HTTP/1.1" 200 None 2026-05-10 17:57:12,946 - lava_callback - DEBUG - Processing node 69fe23eae4d4e78cd76b14aa: baseline-arm64-baylibre 2026-05-10 17:57:12,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe23eae4d4e78cd76b14aa 2026-05-10 17:57:12,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:57:12,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe23eae4d4e78cd76b14aa HTTP/1.1" 200 None 2026-05-10 17:57:12,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:57:13,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 17:57:13,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:57:13,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe23eae4d4e78cd76b14aa HTTP/1.1" 200 None 2026-05-10 17:57:13,049 - lava_callback - ERROR - Error processing callback for node 69fe23eae4d4e78cd76b14aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK 2026-05-10 17:59:13,156 - lava_callback - INFO - Received callback for node 69fe245fe4d4e78cd76b14e8 INFO: 172.21.0.1:44862 - "POST /node/69fe245fe4d4e78cd76b14e8 HTTP/1.0" 202 Accepted 2026-05-10 17:59:13,162 - lava_callback - INFO - Starting async job submit for node 69fe245fe4d4e78cd76b14e8 2026-05-10 17:59:13,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:59:13,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe245fe4d4e78cd76b14e8 HTTP/1.1" 200 None 2026-05-10 17:59:13,177 - lava_callback - DEBUG - Processing node 69fe245fe4d4e78cd76b14e8: baseline-arm64-baylibre 2026-05-10 17:59:13,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe245fe4d4e78cd76b14e8 2026-05-10 17:59:13,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:59:13,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe245fe4d4e78cd76b14e8 HTTP/1.1" 200 None 2026-05-10 17:59:13,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:59:13,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 17:59:13,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 17:59:13,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe245fe4d4e78cd76b14e8 HTTP/1.1" 200 None 2026-05-10 17:59:13,256 - lava_callback - ERROR - Error processing callback for node 69fe245fe4d4e78cd76b14e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:00:44,875 - lava_callback - INFO - Received callback for node 6a00c60e379c7180ed786d1c INFO: 172.21.0.1:35376 - "POST /node/6a00c60e379c7180ed786d1c HTTP/1.0" 202 Accepted 2026-05-10 18:00:44,883 - lava_callback - INFO - Starting async job submit for node 6a00c60e379c7180ed786d1c 2026-05-10 18:00:44,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:00:44,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c60e379c7180ed786d1c HTTP/1.1" 200 None 2026-05-10 18:00:44,934 - lava_callback - DEBUG - Processing node 6a00c60e379c7180ed786d1c: baseline-arm64 2026-05-10 18:00:45,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:00:45,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:00:45,610 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00c60e379c7180ed786d1c/log.txt.gz 2026-05-10 18:00:45,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:00:45,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:00:46,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00c60e379c7180ed786d1c/lava-logs.yaml 2026-05-10 18:00:46,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:00:46,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:00:46,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a00c60e379c7180ed786d1c/lava_callback.json.gz DEBUG: Setup failed for 6a00c60e379c7180ed786d1c. Transitting job node result: incomplete -> fail 2026-05-10 18:00:46,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:00:46,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c60e379c7180ed786d1c HTTP/1.1" 200 None 2026-05-10 18:00:46,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:00:46,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 18:00:46,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:00:46,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c60e379c7180ed786d1c HTTP/1.1" 200 None 2026-05-10 18:00:46,356 - lava_callback - INFO - Completed processing callback for node 6a00c60e379c7180ed786d1c INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:00:49,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:00:49,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:00:59,739 - lava_callback - INFO - Received callback for node 6a00c3b7379c7180ed786c55 INFO: 172.21.0.1:58270 - "POST /node/6a00c3b7379c7180ed786c55 HTTP/1.0" 202 Accepted 2026-05-10 18:00:59,745 - lava_callback - INFO - Starting async job submit for node 6a00c3b7379c7180ed786c55 2026-05-10 18:00:59,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:00:59,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c3b7379c7180ed786c55 HTTP/1.1" 200 None 2026-05-10 18:00:59,827 - lava_callback - DEBUG - Processing node 6a00c3b7379c7180ed786c55: ltp-smoke 2026-05-10 18:01:00,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:01:00,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:01:00,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00c3b7379c7180ed786c55/log.txt.gz 2026-05-10 18:01:00,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:01:00,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:01:00,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00c3b7379c7180ed786c55/lava-logs.yaml 2026-05-10 18:01:00,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:01:00,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:01:00,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00c3b7379c7180ed786c55/lava_callback.json.gz 2026-05-10 18:01:01,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:01:01,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c3b7379c7180ed786c55 HTTP/1.1" 200 None 2026-05-10 18:01:01,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:01:01,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af89379c7180ed783980 HTTP/1.1" 200 None 2026-05-10 18:01:01,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:01:01,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c3b7379c7180ed786c55 HTTP/1.1" 200 None 2026-05-10 18:01:01,273 - lava_callback - INFO - Completed processing callback for node 6a00c3b7379c7180ed786c55 INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:01:19,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:01:19,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42140 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:02:32,751 - lava_callback - INFO - Received callback for node 69fe2531e4d4e78cd76b154e INFO: 172.21.0.1:52888 - "POST /node/69fe2531e4d4e78cd76b154e HTTP/1.0" 202 Accepted 2026-05-10 18:02:32,756 - lava_callback - INFO - Starting async job submit for node 69fe2531e4d4e78cd76b154e 2026-05-10 18:02:32,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:02:32,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2531e4d4e78cd76b154e HTTP/1.1" 200 None 2026-05-10 18:02:32,797 - lava_callback - DEBUG - Processing node 69fe2531e4d4e78cd76b154e: baseline-arm64-clabbe 2026-05-10 18:02:32,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2531e4d4e78cd76b154e 2026-05-10 18:02:32,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:02:32,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2531e4d4e78cd76b154e HTTP/1.1" 200 None 2026-05-10 18:02:32,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:02:32,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 18:02:32,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:02:32,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2531e4d4e78cd76b154e HTTP/1.1" 200 None 2026-05-10 18:02:32,851 - lava_callback - ERROR - Error processing callback for node 69fe2531e4d4e78cd76b154e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:02:54,515 - lava_callback - INFO - Received callback for node 6a00c470379c7180ed786ca2 INFO: 172.21.0.1:51662 - "POST /node/6a00c470379c7180ed786ca2 HTTP/1.0" 202 Accepted 2026-05-10 18:02:54,522 - lava_callback - INFO - Starting async job submit for node 6a00c470379c7180ed786ca2 2026-05-10 18:02:54,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:02:54,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c470379c7180ed786ca2 HTTP/1.1" 200 None 2026-05-10 18:02:54,619 - lava_callback - DEBUG - Processing node 6a00c470379c7180ed786ca2: baseline-arm 2026-05-10 18:02:55,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:02:55,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:02:55,462 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00c470379c7180ed786ca2/log.txt.gz 2026-05-10 18:02:55,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:02:55,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:02:55,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00c470379c7180ed786ca2/lava-logs.yaml 2026-05-10 18:02:56,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:02:56,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:02:56,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00c470379c7180ed786ca2/lava_callback.json.gz DEBUG: Setup failed for 6a00c470379c7180ed786ca2. Transitting job node result: incomplete -> fail 2026-05-10 18:02:56,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:02:56,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c470379c7180ed786ca2 HTTP/1.1" 200 None 2026-05-10 18:02:56,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:02:56,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 18:02:56,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:02:56,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c470379c7180ed786ca2 HTTP/1.1" 200 None 2026-05-10 18:02:56,475 - lava_callback - INFO - Completed processing callback for node 6a00c470379c7180ed786ca2 INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:03:19,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:03:19,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:03:53,005 - lava_callback - INFO - Received callback for node 69fe2578e4d4e78cd76b1570 INFO: 172.21.0.1:35668 - "POST /node/69fe2578e4d4e78cd76b1570 HTTP/1.0" 202 Accepted 2026-05-10 18:03:53,010 - lava_callback - INFO - Starting async job submit for node 69fe2578e4d4e78cd76b1570 2026-05-10 18:03:53,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:03:53,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2578e4d4e78cd76b1570 HTTP/1.1" 200 None 2026-05-10 18:03:53,026 - lava_callback - DEBUG - Processing node 69fe2578e4d4e78cd76b1570: baseline-arm64-baylibre 2026-05-10 18:03:53,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2578e4d4e78cd76b1570 2026-05-10 18:03:53,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:03:53,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2578e4d4e78cd76b1570 HTTP/1.1" 200 None 2026-05-10 18:03:53,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:03:53,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:03:53,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:03:53,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2578e4d4e78cd76b1570 HTTP/1.1" 200 None 2026-05-10 18:03:53,092 - lava_callback - ERROR - Error processing callback for node 69fe2578e4d4e78cd76b1570: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:04:18,783 - lava_callback - INFO - Received callback for node 6a00c40f379c7180ed786c82 INFO: 172.21.0.1:35070 - "POST /node/6a00c40f379c7180ed786c82 HTTP/1.0" 202 Accepted 2026-05-10 18:04:18,829 - lava_callback - INFO - Starting async job submit for node 6a00c40f379c7180ed786c82 2026-05-10 18:04:18,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:04:18,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c40f379c7180ed786c82 HTTP/1.1" 200 None 2026-05-10 18:04:18,876 - lava_callback - DEBUG - Processing node 6a00c40f379c7180ed786c82: baseline-arm-pengutronix 2026-05-10 18:04:19,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:04:22,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:04:22,982 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00c40f379c7180ed786c82/log.txt.gz 2026-05-10 18:04:23,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:04:23,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:04:23,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00c40f379c7180ed786c82/lava-logs.yaml 2026-05-10 18:04:23,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:04:23,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:04:23,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00c40f379c7180ed786c82/lava_callback.json.gz DEBUG: Setup failed for 6a00c40f379c7180ed786c82. Transitting job node result: incomplete -> fail 2026-05-10 18:04:23,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:04:23,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c40f379c7180ed786c82 HTTP/1.1" 200 None 2026-05-10 18:04:23,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:04:23,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 18:04:23,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:04:23,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c40f379c7180ed786c82 HTTP/1.1" 200 None 2026-05-10 18:04:23,464 - lava_callback - INFO - Completed processing callback for node 6a00c40f379c7180ed786c82 INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:04:49,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:04:49,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52850 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:05:10,957 - lava_callback - INFO - Received callback for node 6a00be21379c7180ed786994 INFO: 172.21.0.1:35144 - "POST /node/6a00be21379c7180ed786994 HTTP/1.0" 202 Accepted 2026-05-10 18:05:10,966 - lava_callback - INFO - Starting async job submit for node 6a00be21379c7180ed786994 2026-05-10 18:05:11,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:05:11,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00be21379c7180ed786994 HTTP/1.1" 200 None 2026-05-10 18:05:11,031 - lava_callback - DEBUG - Processing node 6a00be21379c7180ed786994: baseline-nfs-arm64 2026-05-10 18:05:12,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:05:12,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:05:12,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00be21379c7180ed786994/log.txt.gz 2026-05-10 18:05:12,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:05:13,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:05:13,224 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00be21379c7180ed786994/lava-logs.yaml 2026-05-10 18:05:13,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:05:13,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:05:13,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00be21379c7180ed786994/lava_callback.json.gz DEBUG: Setup failed for 6a00be21379c7180ed786994. Transitting job node result: incomplete -> fail 2026-05-10 18:05:13,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:05:13,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00be21379c7180ed786994 HTTP/1.1" 200 None 2026-05-10 18:05:13,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:05:13,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 18:05:13,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:05:13,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00be21379c7180ed786994 HTTP/1.1" 200 None 2026-05-10 18:05:13,630 - lava_callback - INFO - Completed processing callback for node 6a00be21379c7180ed786994 INFO: 172.21.0.1:35154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:05:19,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:05:19,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:06:33,174 - lava_callback - INFO - Received callback for node 69fe2617e4d4e78cd76b15c6 INFO: 172.21.0.1:42604 - "POST /node/69fe2617e4d4e78cd76b15c6 HTTP/1.0" 202 Accepted 2026-05-10 18:06:33,180 - lava_callback - INFO - Starting async job submit for node 69fe2617e4d4e78cd76b15c6 2026-05-10 18:06:33,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:06:33,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2617e4d4e78cd76b15c6 HTTP/1.1" 200 None 2026-05-10 18:06:33,198 - lava_callback - DEBUG - Processing node 69fe2617e4d4e78cd76b15c6: baseline-arm64-baylibre 2026-05-10 18:06:33,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2617e4d4e78cd76b15c6 2026-05-10 18:06:33,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:06:33,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2617e4d4e78cd76b15c6 HTTP/1.1" 200 None 2026-05-10 18:06:33,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:06:33,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:06:33,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:06:33,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2617e4d4e78cd76b15c6 HTTP/1.1" 200 None 2026-05-10 18:06:33,250 - lava_callback - ERROR - Error processing callback for node 69fe2617e4d4e78cd76b15c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET /node/69f69a481f903fec0b0de761%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:09:13,298 - lava_callback - INFO - Received callback for node 69fe26bde4d4e78cd76b161c INFO: 172.21.0.1:60874 - "POST /node/69fe26bde4d4e78cd76b161c HTTP/1.0" 202 Accepted 2026-05-10 18:09:13,304 - lava_callback - INFO - Starting async job submit for node 69fe26bde4d4e78cd76b161c 2026-05-10 18:09:13,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:09:13,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe26bde4d4e78cd76b161c HTTP/1.1" 200 None 2026-05-10 18:09:13,319 - lava_callback - DEBUG - Processing node 69fe26bde4d4e78cd76b161c: baseline-arm64-baylibre 2026-05-10 18:09:13,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe26bde4d4e78cd76b161c 2026-05-10 18:09:13,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:09:13,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe26bde4d4e78cd76b161c HTTP/1.1" 200 None 2026-05-10 18:09:13,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:09:13,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:09:13,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:09:13,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe26bde4d4e78cd76b161c HTTP/1.1" 200 None 2026-05-10 18:09:13,381 - lava_callback - ERROR - Error processing callback for node 69fe26bde4d4e78cd76b161c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET /node/6988c1b39fc35f969e1edee0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:10:33,446 - lava_callback - INFO - Received callback for node 69fe2711e4d4e78cd76b1646 INFO: 172.21.0.1:33568 - "POST /node/69fe2711e4d4e78cd76b1646 HTTP/1.0" 202 Accepted 2026-05-10 18:10:33,452 - lava_callback - INFO - Starting async job submit for node 69fe2711e4d4e78cd76b1646 2026-05-10 18:10:33,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:10:33,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2711e4d4e78cd76b1646 HTTP/1.1" 200 None 2026-05-10 18:10:33,467 - lava_callback - DEBUG - Processing node 69fe2711e4d4e78cd76b1646: baseline-arm64-baylibre 2026-05-10 18:10:33,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2711e4d4e78cd76b1646 2026-05-10 18:10:33,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:10:33,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2711e4d4e78cd76b1646 HTTP/1.1" 200 None 2026-05-10 18:10:33,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:10:33,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:10:33,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:10:33,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2711e4d4e78cd76b1646 HTTP/1.1" 200 None 2026-05-10 18:10:33,510 - lava_callback - ERROR - Error processing callback for node 69fe2711e4d4e78cd76b1646: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:11:53,534 - lava_callback - INFO - Received callback for node 69fe2764e4d4e78cd76b1671 INFO: 172.21.0.1:36218 - "POST /node/69fe2764e4d4e78cd76b1671 HTTP/1.0" 202 Accepted 2026-05-10 18:11:53,543 - lava_callback - INFO - Starting async job submit for node 69fe2764e4d4e78cd76b1671 2026-05-10 18:11:53,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:11:53,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2764e4d4e78cd76b1671 HTTP/1.1" 200 None 2026-05-10 18:11:53,563 - lava_callback - DEBUG - Processing node 69fe2764e4d4e78cd76b1671: baseline-arm64-baylibre 2026-05-10 18:11:53,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2764e4d4e78cd76b1671 2026-05-10 18:11:53,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:11:53,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2764e4d4e78cd76b1671 HTTP/1.1" 200 None 2026-05-10 18:11:53,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:11:53,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:11:53,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:11:53,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2764e4d4e78cd76b1671 HTTP/1.1" 200 None 2026-05-10 18:11:53,621 - lava_callback - ERROR - Error processing callback for node 69fe2764e4d4e78cd76b1671: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:13:13,578 - lava_callback - INFO - Received callback for node 69fe27b8e4d4e78cd76b1695 INFO: 172.21.0.1:53946 - "POST /node/69fe27b8e4d4e78cd76b1695 HTTP/1.0" 202 Accepted 2026-05-10 18:13:13,585 - lava_callback - INFO - Starting async job submit for node 69fe27b8e4d4e78cd76b1695 2026-05-10 18:13:13,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:13:13,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe27b8e4d4e78cd76b1695 HTTP/1.1" 200 None 2026-05-10 18:13:13,601 - lava_callback - DEBUG - Processing node 69fe27b8e4d4e78cd76b1695: baseline-arm64-baylibre 2026-05-10 18:13:13,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe27b8e4d4e78cd76b1695 2026-05-10 18:13:13,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:13:13,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe27b8e4d4e78cd76b1695 HTTP/1.1" 200 None 2026-05-10 18:13:13,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:13:13,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:13:13,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:13:13,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe27b8e4d4e78cd76b1695 HTTP/1.1" 200 None 2026-05-10 18:13:13,669 - lava_callback - ERROR - Error processing callback for node 69fe27b8e4d4e78cd76b1695: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:14:53,313 - lava_callback - INFO - Received callback for node 69fe2813e4d4e78cd76b16cd INFO: 172.21.0.1:34262 - "POST /node/69fe2813e4d4e78cd76b16cd HTTP/1.0" 202 Accepted 2026-05-10 18:14:53,320 - lava_callback - INFO - Starting async job submit for node 69fe2813e4d4e78cd76b16cd 2026-05-10 18:14:53,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:14:53,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2813e4d4e78cd76b16cd HTTP/1.1" 200 None 2026-05-10 18:14:53,335 - lava_callback - DEBUG - Processing node 69fe2813e4d4e78cd76b16cd: baseline-arm64-clabbe 2026-05-10 18:14:53,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2813e4d4e78cd76b16cd 2026-05-10 18:14:53,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:14:53,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2813e4d4e78cd76b16cd HTTP/1.1" 200 None 2026-05-10 18:14:53,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:14:53,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:14:53,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:14:53,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2813e4d4e78cd76b16cd HTTP/1.1" 200 None 2026-05-10 18:14:53,388 - lava_callback - ERROR - Error processing callback for node 69fe2813e4d4e78cd76b16cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:16:13,344 - lava_callback - INFO - Received callback for node 69fe2867e4d4e78cd76b16ef INFO: 172.21.0.1:58134 - "POST /node/69fe2867e4d4e78cd76b16ef HTTP/1.0" 202 Accepted 2026-05-10 18:16:13,350 - lava_callback - INFO - Starting async job submit for node 69fe2867e4d4e78cd76b16ef 2026-05-10 18:16:13,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:16:13,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2867e4d4e78cd76b16ef HTTP/1.1" 200 None 2026-05-10 18:16:13,366 - lava_callback - DEBUG - Processing node 69fe2867e4d4e78cd76b16ef: baseline-arm64-clabbe 2026-05-10 18:16:13,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2867e4d4e78cd76b16ef 2026-05-10 18:16:13,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:16:13,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2867e4d4e78cd76b16ef HTTP/1.1" 200 None 2026-05-10 18:16:13,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:16:13,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:16:13,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:16:13,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2867e4d4e78cd76b16ef HTTP/1.1" 200 None 2026-05-10 18:16:13,412 - lava_callback - ERROR - Error processing callback for node 69fe2867e4d4e78cd76b16ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:18:20,379 - lava_callback - INFO - Received callback for node 6a00c7de379c7180ed786d4d INFO: 172.21.0.1:46832 - "POST /node/6a00c7de379c7180ed786d4d HTTP/1.0" 202 Accepted 2026-05-10 18:18:20,387 - lava_callback - INFO - Starting async job submit for node 6a00c7de379c7180ed786d4d 2026-05-10 18:18:20,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:20,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c7de379c7180ed786d4d HTTP/1.1" 200 None 2026-05-10 18:18:20,462 - lava_callback - DEBUG - Processing node 6a00c7de379c7180ed786d4d: ltp-smoke 2026-05-10 18:18:20,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:18:21,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:18:21,050 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00c7de379c7180ed786d4d/log.txt.gz 2026-05-10 18:18:21,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:18:21,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:18:21,669 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00c7de379c7180ed786d4d/lava-logs.yaml 2026-05-10 18:18:21,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:18:21,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:18:21,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a00c7de379c7180ed786d4d/lava_callback.json.gz 2026-05-10 18:18:21,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:21,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c7de379c7180ed786d4d HTTP/1.1" 200 None 2026-05-10 18:18:21,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:21,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af89379c7180ed783980 HTTP/1.1" 200 None 2026-05-10 18:18:21,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:22,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c7de379c7180ed786d4d HTTP/1.1" 200 None 2026-05-10 18:18:22,116 - lava_callback - INFO - Completed processing callback for node 6a00c7de379c7180ed786d4d INFO: 172.21.0.1:46838 - "GET /node/685d055e6e9add64ba7d2135%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:18:49,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:49,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 18:18:53,441 - lava_callback - INFO - Received callback for node 69fe28fae4d4e78cd76b1722 INFO: 172.21.0.1:34790 - "POST /node/69fe28fae4d4e78cd76b1722 HTTP/1.0" 202 Accepted 2026-05-10 18:18:53,446 - lava_callback - INFO - Starting async job submit for node 69fe28fae4d4e78cd76b1722 2026-05-10 18:18:53,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:53,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe28fae4d4e78cd76b1722 HTTP/1.1" 200 None 2026-05-10 18:18:53,462 - lava_callback - DEBUG - Processing node 69fe28fae4d4e78cd76b1722: baseline-arm64-clabbe 2026-05-10 18:18:53,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe28fae4d4e78cd76b1722 2026-05-10 18:18:53,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:53,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe28fae4d4e78cd76b1722 HTTP/1.1" 200 None 2026-05-10 18:18:53,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:53,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:18:53,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:18:53,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe28fae4d4e78cd76b1722 HTTP/1.1" 200 None 2026-05-10 18:18:53,530 - lava_callback - ERROR - Error processing callback for node 69fe28fae4d4e78cd76b1722: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:19:39,563 - lava_callback - INFO - Received callback for node 6a00c851379c7180ed786d5c INFO: 172.21.0.1:34558 - "POST /node/6a00c851379c7180ed786d5c HTTP/1.0" 202 Accepted 2026-05-10 18:19:39,570 - lava_callback - INFO - Starting async job submit for node 6a00c851379c7180ed786d5c 2026-05-10 18:19:39,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:19:39,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c851379c7180ed786d5c HTTP/1.1" 200 None 2026-05-10 18:19:39,638 - lava_callback - DEBUG - Processing node 6a00c851379c7180ed786d5c: baseline-arm 2026-05-10 18:19:40,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:19:40,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:19:40,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a00c851379c7180ed786d5c/log.txt.gz 2026-05-10 18:19:40,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:19:41,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:19:41,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a00c851379c7180ed786d5c/lava-logs.yaml 2026-05-10 18:19:41,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:19:41,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:19:41,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a00c851379c7180ed786d5c/lava_callback.json.gz DEBUG: Setup failed for 6a00c851379c7180ed786d5c. Transitting job node result: incomplete -> fail 2026-05-10 18:19:41,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:19:41,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c851379c7180ed786d5c HTTP/1.1" 200 None 2026-05-10 18:19:41,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:19:41,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 18:19:41,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:19:41,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c851379c7180ed786d5c HTTP/1.1" 200 None 2026-05-10 18:19:41,483 - lava_callback - INFO - Completed processing callback for node 6a00c851379c7180ed786d5c INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:19:49,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:19:49,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:20:13,585 - lava_callback - INFO - Received callback for node 69fe294de4d4e78cd76b1744 INFO: 172.21.0.1:45396 - "POST /node/69fe294de4d4e78cd76b1744 HTTP/1.0" 202 Accepted 2026-05-10 18:20:13,590 - lava_callback - INFO - Starting async job submit for node 69fe294de4d4e78cd76b1744 2026-05-10 18:20:13,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:20:13,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe294de4d4e78cd76b1744 HTTP/1.1" 200 None 2026-05-10 18:20:13,605 - lava_callback - DEBUG - Processing node 69fe294de4d4e78cd76b1744: baseline-arm64-clabbe 2026-05-10 18:20:13,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe294de4d4e78cd76b1744 2026-05-10 18:20:13,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:20:13,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe294de4d4e78cd76b1744 HTTP/1.1" 200 None 2026-05-10 18:20:13,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:20:13,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:20:13,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:20:13,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe294de4d4e78cd76b1744 HTTP/1.1" 200 None 2026-05-10 18:20:13,656 - lava_callback - ERROR - Error processing callback for node 69fe294de4d4e78cd76b1744: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:21:33,598 - lava_callback - INFO - Received callback for node 69fe29a3e4d4e78cd76b176f INFO: 172.21.0.1:45000 - "POST /node/69fe29a3e4d4e78cd76b176f HTTP/1.0" 202 Accepted 2026-05-10 18:21:33,603 - lava_callback - INFO - Starting async job submit for node 69fe29a3e4d4e78cd76b176f 2026-05-10 18:21:33,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:21:33,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe29a3e4d4e78cd76b176f HTTP/1.1" 200 None 2026-05-10 18:21:33,629 - lava_callback - DEBUG - Processing node 69fe29a3e4d4e78cd76b176f: baseline-arm64-clabbe 2026-05-10 18:21:33,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe29a3e4d4e78cd76b176f 2026-05-10 18:21:33,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:21:33,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe29a3e4d4e78cd76b176f HTTP/1.1" 200 None 2026-05-10 18:21:33,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:21:33,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:21:33,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:21:33,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe29a3e4d4e78cd76b176f HTTP/1.1" 200 None 2026-05-10 18:21:33,700 - lava_callback - ERROR - Error processing callback for node 69fe29a3e4d4e78cd76b176f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:24:13,680 - lava_callback - INFO - Received callback for node 69fe2a49e4d4e78cd76b17bc INFO: 172.21.0.1:49494 - "POST /node/69fe2a49e4d4e78cd76b17bc HTTP/1.0" 202 Accepted 2026-05-10 18:24:13,686 - lava_callback - INFO - Starting async job submit for node 69fe2a49e4d4e78cd76b17bc 2026-05-10 18:24:13,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:24:13,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2a49e4d4e78cd76b17bc HTTP/1.1" 200 None 2026-05-10 18:24:13,701 - lava_callback - DEBUG - Processing node 69fe2a49e4d4e78cd76b17bc: baseline-arm64-clabbe 2026-05-10 18:24:13,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2a49e4d4e78cd76b17bc 2026-05-10 18:24:13,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:24:13,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2a49e4d4e78cd76b17bc HTTP/1.1" 200 None 2026-05-10 18:24:13,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:24:13,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-10 18:24:13,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:24:13,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2a49e4d4e78cd76b17bc HTTP/1.1" 200 None 2026-05-10 18:24:13,752 - lava_callback - ERROR - Error processing callback for node 69fe2a49e4d4e78cd76b17bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:25:50,197 - lava_callback - INFO - Received callback for node 6a00c902379c7180ed786da5 INFO: 172.21.0.1:53596 - "POST /node/6a00c902379c7180ed786da5 HTTP/1.0" 202 Accepted 2026-05-10 18:25:50,206 - lava_callback - INFO - Starting async job submit for node 6a00c902379c7180ed786da5 2026-05-10 18:25:50,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:25:50,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c902379c7180ed786da5 HTTP/1.1" 200 None 2026-05-10 18:25:50,265 - lava_callback - DEBUG - Processing node 6a00c902379c7180ed786da5: baseline-nfs-arm64 2026-05-10 18:25:51,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:25:51,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:25:51,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00c902379c7180ed786da5/log.txt.gz 2026-05-10 18:25:52,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:25:52,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:25:52,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00c902379c7180ed786da5/lava-logs.yaml 2026-05-10 18:25:52,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:25:52,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:25:52,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00c902379c7180ed786da5/lava_callback.json.gz DEBUG: Setup failed for 6a00c902379c7180ed786da5. Transitting job node result: incomplete -> fail 2026-05-10 18:25:52,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:25:52,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c902379c7180ed786da5 HTTP/1.1" 200 None 2026-05-10 18:25:52,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:25:52,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 18:25:52,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:25:52,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c902379c7180ed786da5 HTTP/1.1" 200 None 2026-05-10 18:25:52,813 - lava_callback - INFO - Completed processing callback for node 6a00c902379c7180ed786da5 2026-05-10 18:25:53,745 - lava_callback - INFO - Received callback for node 69fe2a9ce4d4e78cd76b17e7 INFO: 172.21.0.1:53600 - "POST /node/69fe2a9ce4d4e78cd76b17e7 HTTP/1.0" 202 Accepted 2026-05-10 18:25:53,751 - lava_callback - INFO - Starting async job submit for node 69fe2a9ce4d4e78cd76b17e7 2026-05-10 18:25:53,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:25:53,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2a9ce4d4e78cd76b17e7 HTTP/1.1" 200 None 2026-05-10 18:25:53,778 - lava_callback - DEBUG - Processing node 69fe2a9ce4d4e78cd76b17e7: baseline-arm64-clabbe 2026-05-10 18:25:53,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2a9ce4d4e78cd76b17e7 2026-05-10 18:25:53,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:25:53,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2a9ce4d4e78cd76b17e7 HTTP/1.1" 200 None 2026-05-10 18:25:53,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:25:53,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 18:25:53,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:25:53,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2a9ce4d4e78cd76b17e7 HTTP/1.1" 200 None 2026-05-10 18:25:53,825 - lava_callback - ERROR - Error processing callback for node 69fe2a9ce4d4e78cd76b17e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:26:19,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:26:19,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:27:13,786 - lava_callback - INFO - Received callback for node 69fe2aeee4d4e78cd76b1812 INFO: 172.21.0.1:38672 - "POST /node/69fe2aeee4d4e78cd76b1812 HTTP/1.0" 202 Accepted 2026-05-10 18:27:13,791 - lava_callback - INFO - Starting async job submit for node 69fe2aeee4d4e78cd76b1812 2026-05-10 18:27:13,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:27:13,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2aeee4d4e78cd76b1812 HTTP/1.1" 200 None 2026-05-10 18:27:13,806 - lava_callback - DEBUG - Processing node 69fe2aeee4d4e78cd76b1812: baseline-arm64-clabbe 2026-05-10 18:27:13,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2aeee4d4e78cd76b1812 2026-05-10 18:27:13,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:27:13,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2aeee4d4e78cd76b1812 HTTP/1.1" 200 None 2026-05-10 18:27:13,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:27:13,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 18:27:13,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:27:13,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2aeee4d4e78cd76b1812 HTTP/1.1" 200 None 2026-05-10 18:27:13,850 - lava_callback - ERROR - Error processing callback for node 69fe2aeee4d4e78cd76b1812: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:28:14,472 - lava_callback - INFO - Received callback for node 69fe2b2ee4d4e78cd76b1836 INFO: 172.21.0.1:36432 - "POST /node/69fe2b2ee4d4e78cd76b1836 HTTP/1.0" 202 Accepted 2026-05-10 18:28:14,478 - lava_callback - INFO - Starting async job submit for node 69fe2b2ee4d4e78cd76b1836 2026-05-10 18:28:14,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:28:14,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2b2ee4d4e78cd76b1836 HTTP/1.1" 200 None 2026-05-10 18:28:14,494 - lava_callback - DEBUG - Processing node 69fe2b2ee4d4e78cd76b1836: baseline-arm-baylibre 2026-05-10 18:28:14,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2b2ee4d4e78cd76b1836 2026-05-10 18:28:14,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:28:14,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2b2ee4d4e78cd76b1836 HTTP/1.1" 200 None 2026-05-10 18:28:14,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:28:14,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:28:14,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:28:14,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2b2ee4d4e78cd76b1836 HTTP/1.1" 200 None 2026-05-10 18:28:14,545 - lava_callback - ERROR - Error processing callback for node 69fe2b2ee4d4e78cd76b1836: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:29:13,861 - lava_callback - INFO - Received callback for node 69fe2b69e4d4e78cd76b184f INFO: 172.21.0.1:57448 - "POST /node/69fe2b69e4d4e78cd76b184f HTTP/1.0" 202 Accepted 2026-05-10 18:29:13,867 - lava_callback - INFO - Starting async job submit for node 69fe2b69e4d4e78cd76b184f 2026-05-10 18:29:13,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:29:13,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2b69e4d4e78cd76b184f HTTP/1.1" 200 None 2026-05-10 18:29:13,883 - lava_callback - DEBUG - Processing node 69fe2b69e4d4e78cd76b184f: baseline-arm64-clabbe 2026-05-10 18:29:13,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2b69e4d4e78cd76b184f 2026-05-10 18:29:13,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:29:13,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2b69e4d4e78cd76b184f HTTP/1.1" 200 None 2026-05-10 18:29:13,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:29:13,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 18:29:13,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:29:13,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2b69e4d4e78cd76b184f HTTP/1.1" 200 None 2026-05-10 18:29:13,952 - lava_callback - ERROR - Error processing callback for node 69fe2b69e4d4e78cd76b184f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:30:14,883 - lava_callback - INFO - Received callback for node 69fe2ba8e4d4e78cd76b1873 INFO: 172.21.0.1:50676 - "POST /node/69fe2ba8e4d4e78cd76b1873 HTTP/1.0" 202 Accepted 2026-05-10 18:30:14,889 - lava_callback - INFO - Starting async job submit for node 69fe2ba8e4d4e78cd76b1873 2026-05-10 18:30:14,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:30:14,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2ba8e4d4e78cd76b1873 HTTP/1.1" 200 None 2026-05-10 18:30:14,909 - lava_callback - DEBUG - Processing node 69fe2ba8e4d4e78cd76b1873: baseline-arm-baylibre 2026-05-10 18:30:14,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2ba8e4d4e78cd76b1873 2026-05-10 18:30:14,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:30:14,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2ba8e4d4e78cd76b1873 HTTP/1.1" 200 None 2026-05-10 18:30:14,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:30:14,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:30:14,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:30:14,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2ba8e4d4e78cd76b1873 HTTP/1.1" 200 None 2026-05-10 18:30:14,975 - lava_callback - ERROR - Error processing callback for node 69fe2ba8e4d4e78cd76b1873: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:30:54,537 - lava_callback - INFO - Received callback for node 69fe2bcee4d4e78cd76b1883 INFO: 172.21.0.1:60234 - "POST /node/69fe2bcee4d4e78cd76b1883 HTTP/1.0" 202 Accepted 2026-05-10 18:30:54,542 - lava_callback - INFO - Starting async job submit for node 69fe2bcee4d4e78cd76b1883 2026-05-10 18:30:54,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:30:54,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2bcee4d4e78cd76b1883 HTTP/1.1" 200 None 2026-05-10 18:30:54,570 - lava_callback - DEBUG - Processing node 69fe2bcee4d4e78cd76b1883: baseline-arm-baylibre 2026-05-10 18:30:54,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2bcee4d4e78cd76b1883 2026-05-10 18:30:54,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:30:54,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2bcee4d4e78cd76b1883 HTTP/1.1" 200 None 2026-05-10 18:30:54,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:30:54,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:30:54,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:30:54,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2bcee4d4e78cd76b1883 HTTP/1.1" 200 None 2026-05-10 18:30:54,615 - lava_callback - ERROR - Error processing callback for node 69fe2bcee4d4e78cd76b1883: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:31:34,782 - lava_callback - INFO - Received callback for node 69fe2bf4e4d4e78cd76b189f INFO: 172.21.0.1:35508 - "POST /node/69fe2bf4e4d4e78cd76b189f HTTP/1.0" 202 Accepted 2026-05-10 18:31:34,788 - lava_callback - INFO - Starting async job submit for node 69fe2bf4e4d4e78cd76b189f 2026-05-10 18:31:34,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:31:34,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2bf4e4d4e78cd76b189f HTTP/1.1" 200 None 2026-05-10 18:31:34,804 - lava_callback - DEBUG - Processing node 69fe2bf4e4d4e78cd76b189f: baseline-arm-baylibre 2026-05-10 18:31:34,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2bf4e4d4e78cd76b189f 2026-05-10 18:31:34,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:31:34,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2bf4e4d4e78cd76b189f HTTP/1.1" 200 None 2026-05-10 18:31:34,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:31:34,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:31:34,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:31:34,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2bf4e4d4e78cd76b189f HTTP/1.1" 200 None 2026-05-10 18:31:34,855 - lava_callback - ERROR - Error processing callback for node 69fe2bf4e4d4e78cd76b189f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:32:14,162 - lava_callback - INFO - Received callback for node 69fe2c1ee4d4e78cd76b18b1 INFO: 172.21.0.1:45146 - "POST /node/69fe2c1ee4d4e78cd76b18b1 HTTP/1.0" 202 Accepted 2026-05-10 18:32:14,167 - lava_callback - INFO - Starting async job submit for node 69fe2c1ee4d4e78cd76b18b1 2026-05-10 18:32:14,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:32:14,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2c1ee4d4e78cd76b18b1 HTTP/1.1" 200 None 2026-05-10 18:32:14,183 - lava_callback - DEBUG - Processing node 69fe2c1ee4d4e78cd76b18b1: baseline-arm-clabbe 2026-05-10 18:32:14,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2c1ee4d4e78cd76b18b1 2026-05-10 18:32:14,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:32:14,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2c1ee4d4e78cd76b18b1 HTTP/1.1" 200 None 2026-05-10 18:32:14,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:32:14,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:32:14,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:32:14,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2c1ee4d4e78cd76b18b1 HTTP/1.1" 200 None 2026-05-10 18:32:14,226 - lava_callback - ERROR - Error processing callback for node 69fe2c1ee4d4e78cd76b18b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:32:54,682 - lava_callback - INFO - Received callback for node 69fe2c43e4d4e78cd76b18c3 INFO: 172.21.0.1:45106 - "POST /node/69fe2c43e4d4e78cd76b18c3 HTTP/1.0" 202 Accepted 2026-05-10 18:32:54,688 - lava_callback - INFO - Starting async job submit for node 69fe2c43e4d4e78cd76b18c3 2026-05-10 18:32:54,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:32:54,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2c43e4d4e78cd76b18c3 HTTP/1.1" 200 None 2026-05-10 18:32:54,704 - lava_callback - DEBUG - Processing node 69fe2c43e4d4e78cd76b18c3: baseline-arm-baylibre 2026-05-10 18:32:54,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2c43e4d4e78cd76b18c3 2026-05-10 18:32:54,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:32:54,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2c43e4d4e78cd76b18c3 HTTP/1.1" 200 None 2026-05-10 18:32:54,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:32:54,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:32:54,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:32:54,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2c43e4d4e78cd76b18c3 HTTP/1.1" 200 None 2026-05-10 18:32:54,757 - lava_callback - ERROR - Error processing callback for node 69fe2c43e4d4e78cd76b18c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:33:34,077 - lava_callback - INFO - Received callback for node 69fe2c6de4d4e78cd76b18db INFO: 172.21.0.1:34200 - "POST /node/69fe2c6de4d4e78cd76b18db HTTP/1.0" 202 Accepted 2026-05-10 18:33:34,083 - lava_callback - INFO - Starting async job submit for node 69fe2c6de4d4e78cd76b18db 2026-05-10 18:33:34,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:33:34,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2c6de4d4e78cd76b18db HTTP/1.1" 200 None 2026-05-10 18:33:34,101 - lava_callback - DEBUG - Processing node 69fe2c6de4d4e78cd76b18db: baseline-arm-clabbe 2026-05-10 18:33:34,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2c6de4d4e78cd76b18db 2026-05-10 18:33:34,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:33:34,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2c6de4d4e78cd76b18db HTTP/1.1" 200 None 2026-05-10 18:33:34,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:33:34,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:33:34,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:33:34,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2c6de4d4e78cd76b18db HTTP/1.1" 200 None 2026-05-10 18:33:34,158 - lava_callback - ERROR - Error processing callback for node 69fe2c6de4d4e78cd76b18db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:34:14,925 - lava_callback - INFO - Received callback for node 69fe2c93e4d4e78cd76b18ed INFO: 172.21.0.1:43170 - "POST /node/69fe2c93e4d4e78cd76b18ed HTTP/1.0" 202 Accepted 2026-05-10 18:34:14,934 - lava_callback - INFO - Starting async job submit for node 69fe2c93e4d4e78cd76b18ed 2026-05-10 18:34:14,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:34:14,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2c93e4d4e78cd76b18ed HTTP/1.1" 200 None 2026-05-10 18:34:14,956 - lava_callback - DEBUG - Processing node 69fe2c93e4d4e78cd76b18ed: baseline-arm-baylibre 2026-05-10 18:34:14,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2c93e4d4e78cd76b18ed 2026-05-10 18:34:14,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:34:14,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2c93e4d4e78cd76b18ed HTTP/1.1" 200 None 2026-05-10 18:34:14,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:34:14,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:34:14,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:34:15,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2c93e4d4e78cd76b18ed HTTP/1.1" 200 None 2026-05-10 18:34:15,015 - lava_callback - ERROR - Error processing callback for node 69fe2c93e4d4e78cd76b18ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:34:54,178 - lava_callback - INFO - Received callback for node 69fe2cbde4d4e78cd76b1901 INFO: 172.21.0.1:60062 - "POST /node/69fe2cbde4d4e78cd76b1901 HTTP/1.0" 202 Accepted 2026-05-10 18:34:54,186 - lava_callback - INFO - Starting async job submit for node 69fe2cbde4d4e78cd76b1901 2026-05-10 18:34:54,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:34:54,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2cbde4d4e78cd76b1901 HTTP/1.1" 200 None 2026-05-10 18:34:54,201 - lava_callback - DEBUG - Processing node 69fe2cbde4d4e78cd76b1901: baseline-arm-clabbe 2026-05-10 18:34:54,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2cbde4d4e78cd76b1901 2026-05-10 18:34:54,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:34:54,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2cbde4d4e78cd76b1901 HTTP/1.1" 200 None 2026-05-10 18:34:54,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:34:54,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:34:54,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:34:54,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2cbde4d4e78cd76b1901 HTTP/1.1" 200 None 2026-05-10 18:34:54,258 - lava_callback - ERROR - Error processing callback for node 69fe2cbde4d4e78cd76b1901: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:35:34,110 - lava_callback - INFO - Received callback for node 69fe2ce5e4d4e78cd76b1917 INFO: 172.21.0.1:41900 - "POST /node/69fe2ce5e4d4e78cd76b1917 HTTP/1.0" 202 Accepted 2026-05-10 18:35:34,115 - lava_callback - INFO - Starting async job submit for node 69fe2ce5e4d4e78cd76b1917 2026-05-10 18:35:34,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:35:34,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2ce5e4d4e78cd76b1917 HTTP/1.1" 200 None 2026-05-10 18:35:34,140 - lava_callback - DEBUG - Processing node 69fe2ce5e4d4e78cd76b1917: baseline-arm-clabbe 2026-05-10 18:35:34,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2ce5e4d4e78cd76b1917 2026-05-10 18:35:34,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:35:34,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2ce5e4d4e78cd76b1917 HTTP/1.1" 200 None 2026-05-10 18:35:34,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:35:34,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:35:34,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:35:34,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2ce5e4d4e78cd76b1917 HTTP/1.1" 200 None 2026-05-10 18:35:34,198 - lava_callback - ERROR - Error processing callback for node 69fe2ce5e4d4e78cd76b1917: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:36:14,197 - lava_callback - INFO - Received callback for node 69fe2d0de4d4e78cd76b1929 INFO: 172.21.0.1:60272 - "POST /node/69fe2d0de4d4e78cd76b1929 HTTP/1.0" 202 Accepted 2026-05-10 18:36:14,202 - lava_callback - INFO - Starting async job submit for node 69fe2d0de4d4e78cd76b1929 2026-05-10 18:36:14,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:36:14,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2d0de4d4e78cd76b1929 HTTP/1.1" 200 None 2026-05-10 18:36:14,222 - lava_callback - DEBUG - Processing node 69fe2d0de4d4e78cd76b1929: baseline-arm-clabbe 2026-05-10 18:36:14,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2d0de4d4e78cd76b1929 2026-05-10 18:36:14,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:36:14,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2d0de4d4e78cd76b1929 HTTP/1.1" 200 None 2026-05-10 18:36:14,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:36:14,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:36:14,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:36:14,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2d0de4d4e78cd76b1929 HTTP/1.1" 200 None 2026-05-10 18:36:14,273 - lava_callback - ERROR - Error processing callback for node 69fe2d0de4d4e78cd76b1929: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:36:54,203 - lava_callback - INFO - Received callback for node 69fe2d36e4d4e78cd76b193d INFO: 172.21.0.1:56234 - "POST /node/69fe2d36e4d4e78cd76b193d HTTP/1.0" 202 Accepted 2026-05-10 18:36:54,209 - lava_callback - INFO - Starting async job submit for node 69fe2d36e4d4e78cd76b193d 2026-05-10 18:36:54,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:36:54,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2d36e4d4e78cd76b193d HTTP/1.1" 200 None 2026-05-10 18:36:54,228 - lava_callback - DEBUG - Processing node 69fe2d36e4d4e78cd76b193d: baseline-arm-clabbe 2026-05-10 18:36:54,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2d36e4d4e78cd76b193d 2026-05-10 18:36:54,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:36:54,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2d36e4d4e78cd76b193d HTTP/1.1" 200 None 2026-05-10 18:36:54,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:36:54,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a58df29cd80ecaa02a2 HTTP/1.1" 200 None 2026-05-10 18:36:54,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:36:54,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2d36e4d4e78cd76b193d HTTP/1.1" 200 None 2026-05-10 18:36:54,284 - lava_callback - ERROR - Error processing callback for node 69fe2d36e4d4e78cd76b193d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:37:54,244 - lava_callback - INFO - Received callback for node 69fe2d6ee4d4e78cd76b1952 INFO: 172.21.0.1:45844 - "POST /node/69fe2d6ee4d4e78cd76b1952 HTTP/1.0" 202 Accepted 2026-05-10 18:37:54,250 - lava_callback - INFO - Starting async job submit for node 69fe2d6ee4d4e78cd76b1952 2026-05-10 18:37:54,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:37:54,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2d6ee4d4e78cd76b1952 HTTP/1.1" 200 None 2026-05-10 18:37:54,265 - lava_callback - DEBUG - Processing node 69fe2d6ee4d4e78cd76b1952: baseline-arm64-clabbe 2026-05-10 18:37:54,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2d6ee4d4e78cd76b1952 2026-05-10 18:37:54,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:37:54,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2d6ee4d4e78cd76b1952 HTTP/1.1" 200 None 2026-05-10 18:37:54,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:37:54,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 18:37:54,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:37:54,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2d6ee4d4e78cd76b1952 HTTP/1.1" 200 None 2026-05-10 18:37:54,314 - lava_callback - ERROR - Error processing callback for node 69fe2d6ee4d4e78cd76b1952: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:39:14,293 - lava_callback - INFO - Received callback for node 69fe2dc4e4d4e78cd76b1973 INFO: 172.21.0.1:57494 - "POST /node/69fe2dc4e4d4e78cd76b1973 HTTP/1.0" 202 Accepted 2026-05-10 18:39:14,300 - lava_callback - INFO - Starting async job submit for node 69fe2dc4e4d4e78cd76b1973 2026-05-10 18:39:14,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:39:14,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2dc4e4d4e78cd76b1973 HTTP/1.1" 200 None 2026-05-10 18:39:14,320 - lava_callback - DEBUG - Processing node 69fe2dc4e4d4e78cd76b1973: baseline-arm64-clabbe 2026-05-10 18:39:14,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe2dc4e4d4e78cd76b1973 2026-05-10 18:39:14,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:39:14,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe2dc4e4d4e78cd76b1973 HTTP/1.1" 200 None 2026-05-10 18:39:14,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:39:14,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-10 18:39:14,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:39:14,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe2dc4e4d4e78cd76b1973 HTTP/1.1" 200 None 2026-05-10 18:39:14,369 - lava_callback - ERROR - Error processing callback for node 69fe2dc4e4d4e78cd76b1973: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:43:00,435 - lava_callback - INFO - Received callback for node 6a00c8e2379c7180ed786d95 INFO: 172.21.0.1:43014 - "POST /node/6a00c8e2379c7180ed786d95 HTTP/1.0" 202 Accepted 2026-05-10 18:43:00,485 - lava_callback - INFO - Starting async job submit for node 6a00c8e2379c7180ed786d95 2026-05-10 18:43:00,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:43:00,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c8e2379c7180ed786d95 HTTP/1.1" 200 None 2026-05-10 18:43:00,528 - lava_callback - DEBUG - Processing node 6a00c8e2379c7180ed786d95: baseline-arm-pengutronix 2026-05-10 18:43:00,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:43:00,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:43:00,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00c8e2379c7180ed786d95/log.txt.gz 2026-05-10 18:43:00,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:43:00,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:43:00,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00c8e2379c7180ed786d95/lava-logs.yaml 2026-05-10 18:43:00,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:43:01,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:43:01,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00c8e2379c7180ed786d95/lava_callback.json.gz DEBUG: Setup failed for 6a00c8e2379c7180ed786d95. Transitting job node result: incomplete -> fail 2026-05-10 18:43:01,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:43:01,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00c8e2379c7180ed786d95 HTTP/1.1" 200 None 2026-05-10 18:43:01,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:43:01,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 18:43:01,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:43:01,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00c8e2379c7180ed786d95 HTTP/1.1" 200 None 2026-05-10 18:43:01,202 - lava_callback - INFO - Completed processing callback for node 6a00c8e2379c7180ed786d95 INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:43:19,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:43:20,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:45:52,576 - lava_callback - INFO - Received callback for node 6a00cdb8379c7180ed786f83 INFO: 172.21.0.1:47250 - "POST /node/6a00cdb8379c7180ed786f83 HTTP/1.0" 202 Accepted 2026-05-10 18:45:52,590 - lava_callback - INFO - Starting async job submit for node 6a00cdb8379c7180ed786f83 2026-05-10 18:45:52,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:45:52,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00cdb8379c7180ed786f83 HTTP/1.1" 200 None 2026-05-10 18:45:52,673 - lava_callback - DEBUG - Processing node 6a00cdb8379c7180ed786f83: baseline-nfs-arm64 2026-05-10 18:45:53,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:45:53,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:45:53,869 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00cdb8379c7180ed786f83/log.txt.gz 2026-05-10 18:45:54,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:45:54,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:45:54,684 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00cdb8379c7180ed786f83/lava-logs.yaml 2026-05-10 18:45:54,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 18:45:54,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 18:45:54,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a00cdb8379c7180ed786f83/lava_callback.json.gz DEBUG: Setup failed for 6a00cdb8379c7180ed786f83. Transitting job node result: incomplete -> fail 2026-05-10 18:45:54,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:45:54,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00cdb8379c7180ed786f83 HTTP/1.1" 200 None 2026-05-10 18:45:54,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:45:54,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af90379c7180ed783989 HTTP/1.1" 200 None 2026-05-10 18:45:54,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:45:54,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00cdb8379c7180ed786f83 HTTP/1.1" 200 None 2026-05-10 18:45:55,069 - lava_callback - INFO - Completed processing callback for node 6a00cdb8379c7180ed786f83 INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:46:20,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:46:20,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52952 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 18:59:16,116 - lava_callback - INFO - Received callback for node 69fe327ae4d4e78cd76b1c37 INFO: 172.21.0.1:52958 - "POST /node/69fe327ae4d4e78cd76b1c37 HTTP/1.0" 202 Accepted 2026-05-10 18:59:16,122 - lava_callback - INFO - Starting async job submit for node 69fe327ae4d4e78cd76b1c37 2026-05-10 18:59:16,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:59:16,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe327ae4d4e78cd76b1c37 HTTP/1.1" 200 None 2026-05-10 18:59:16,210 - lava_callback - DEBUG - Processing node 69fe327ae4d4e78cd76b1c37: baseline-arm-baylibre 2026-05-10 18:59:16,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe327ae4d4e78cd76b1c37 2026-05-10 18:59:16,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:59:16,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe327ae4d4e78cd76b1c37 HTTP/1.1" 200 None 2026-05-10 18:59:16,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:59:16,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 18:59:16,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:59:16,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe327ae4d4e78cd76b1c37 HTTP/1.1" 200 None 2026-05-10 18:59:16,269 - lava_callback - ERROR - Error processing callback for node 69fe327ae4d4e78cd76b1c37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET / HTTP/1.0" 200 OK 2026-05-10 18:59:56,053 - lava_callback - INFO - Received callback for node 69fe32a1e4d4e78cd76b1c57 INFO: 172.21.0.1:34980 - "POST /node/69fe32a1e4d4e78cd76b1c57 HTTP/1.0" 202 Accepted 2026-05-10 18:59:56,058 - lava_callback - INFO - Starting async job submit for node 69fe32a1e4d4e78cd76b1c57 2026-05-10 18:59:56,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:59:56,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe32a1e4d4e78cd76b1c57 HTTP/1.1" 200 None 2026-05-10 18:59:56,095 - lava_callback - DEBUG - Processing node 69fe32a1e4d4e78cd76b1c57: baseline-arm-baylibre 2026-05-10 18:59:56,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe32a1e4d4e78cd76b1c57 2026-05-10 18:59:56,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:59:56,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe32a1e4d4e78cd76b1c57 HTTP/1.1" 200 None 2026-05-10 18:59:56,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:59:56,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 18:59:56,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 18:59:56,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe32a1e4d4e78cd76b1c57 HTTP/1.1" 200 None 2026-05-10 18:59:56,159 - lava_callback - ERROR - Error processing callback for node 69fe32a1e4d4e78cd76b1c57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36536 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 19:02:16,410 - lava_callback - INFO - Received callback for node 69fe3326e4d4e78cd76b1c96 INFO: 172.21.0.1:36538 - "POST /node/69fe3326e4d4e78cd76b1c96 HTTP/1.0" 202 Accepted 2026-05-10 19:02:16,416 - lava_callback - INFO - Starting async job submit for node 69fe3326e4d4e78cd76b1c96 2026-05-10 19:02:16,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:16,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3326e4d4e78cd76b1c96 HTTP/1.1" 200 None 2026-05-10 19:02:16,432 - lava_callback - DEBUG - Processing node 69fe3326e4d4e78cd76b1c96: baseline-arm-baylibre 2026-05-10 19:02:16,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3326e4d4e78cd76b1c96 2026-05-10 19:02:16,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:16,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3326e4d4e78cd76b1c96 HTTP/1.1" 200 None 2026-05-10 19:02:16,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:16,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:02:16,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:16,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3326e4d4e78cd76b1c96 HTTP/1.1" 200 None 2026-05-10 19:02:16,484 - lava_callback - ERROR - Error processing callback for node 69fe3326e4d4e78cd76b1c96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:02:41,151 - lava_callback - INFO - Received callback for node 6a00d1c3379c7180ed78704b INFO: 172.21.0.1:54178 - "POST /node/6a00d1c3379c7180ed78704b HTTP/1.0" 202 Accepted 2026-05-10 19:02:41,197 - lava_callback - INFO - Starting async job submit for node 6a00d1c3379c7180ed78704b 2026-05-10 19:02:41,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:41,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00d1c3379c7180ed78704b HTTP/1.1" 200 None 2026-05-10 19:02:41,236 - lava_callback - DEBUG - Processing node 6a00d1c3379c7180ed78704b: baseline-arm-pengutronix 2026-05-10 19:02:41,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 19:02:41,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 19:02:41,603 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00d1c3379c7180ed78704b/log.txt.gz 2026-05-10 19:02:41,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 19:02:41,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 19:02:41,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00d1c3379c7180ed78704b/lava-logs.yaml 2026-05-10 19:02:41,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 19:02:42,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 19:02:42,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a00d1c3379c7180ed78704b/lava_callback.json.gz DEBUG: Setup failed for 6a00d1c3379c7180ed78704b. Transitting job node result: incomplete -> fail 2026-05-10 19:02:42,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:42,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00d1c3379c7180ed78704b HTTP/1.1" 200 None 2026-05-10 19:02:42,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:42,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 19:02:42,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:42,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a00d1c3379c7180ed78704b HTTP/1.1" 200 None 2026-05-10 19:02:42,235 - lava_callback - INFO - Completed processing callback for node 6a00d1c3379c7180ed78704b INFO: 172.21.0.1:54186 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:02:50,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:50,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 19:02:56,242 - lava_callback - INFO - Received callback for node 69fe334de4d4e78cd76b1ca8 INFO: 172.21.0.1:47996 - "POST /node/69fe334de4d4e78cd76b1ca8 HTTP/1.0" 202 Accepted 2026-05-10 19:02:56,248 - lava_callback - INFO - Starting async job submit for node 69fe334de4d4e78cd76b1ca8 2026-05-10 19:02:56,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:56,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe334de4d4e78cd76b1ca8 HTTP/1.1" 200 None 2026-05-10 19:02:56,276 - lava_callback - DEBUG - Processing node 69fe334de4d4e78cd76b1ca8: baseline-arm-baylibre 2026-05-10 19:02:56,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe334de4d4e78cd76b1ca8 2026-05-10 19:02:56,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:56,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe334de4d4e78cd76b1ca8 HTTP/1.1" 200 None 2026-05-10 19:02:56,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:56,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:02:56,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:02:56,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe334de4d4e78cd76b1ca8 HTTP/1.1" 200 None 2026-05-10 19:02:56,329 - lava_callback - ERROR - Error processing callback for node 69fe334de4d4e78cd76b1ca8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36666 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:04:36,381 - lava_callback - INFO - Received callback for node 69fe33c1e4d4e78cd76b1cf4 INFO: 172.21.0.1:57480 - "POST /node/69fe33c1e4d4e78cd76b1cf4 HTTP/1.0" 202 Accepted 2026-05-10 19:04:36,387 - lava_callback - INFO - Starting async job submit for node 69fe33c1e4d4e78cd76b1cf4 2026-05-10 19:04:36,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:04:36,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe33c1e4d4e78cd76b1cf4 HTTP/1.1" 200 None 2026-05-10 19:04:36,410 - lava_callback - DEBUG - Processing node 69fe33c1e4d4e78cd76b1cf4: baseline-arm-baylibre 2026-05-10 19:04:36,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe33c1e4d4e78cd76b1cf4 2026-05-10 19:04:36,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:04:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe33c1e4d4e78cd76b1cf4 HTTP/1.1" 200 None 2026-05-10 19:04:36,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:04:36,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:04:36,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:04:36,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe33c1e4d4e78cd76b1cf4 HTTP/1.1" 200 None 2026-05-10 19:04:36,455 - lava_callback - ERROR - Error processing callback for node 69fe33c1e4d4e78cd76b1cf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:07:55,423 - lava_callback - INFO - Received callback for node 69fe3482e4d4e78cd76b1d72 INFO: 172.21.0.1:34038 - "POST /node/69fe3482e4d4e78cd76b1d72 HTTP/1.0" 202 Accepted 2026-05-10 19:07:55,428 - lava_callback - INFO - Starting async job submit for node 69fe3482e4d4e78cd76b1d72 2026-05-10 19:07:55,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:07:55,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3482e4d4e78cd76b1d72 HTTP/1.1" 200 None 2026-05-10 19:07:55,444 - lava_callback - DEBUG - Processing node 69fe3482e4d4e78cd76b1d72: baseline-arm-clabbe 2026-05-10 19:07:55,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3482e4d4e78cd76b1d72 2026-05-10 19:07:55,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:07:55,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3482e4d4e78cd76b1d72 HTTP/1.1" 200 None 2026-05-10 19:07:55,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:07:55,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:07:55,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:07:55,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3482e4d4e78cd76b1d72 HTTP/1.1" 200 None 2026-05-10 19:07:55,498 - lava_callback - ERROR - Error processing callback for node 69fe3482e4d4e78cd76b1d72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:08:35,370 - lava_callback - INFO - Received callback for node 69fe34ace4d4e78cd76b1d86 INFO: 172.21.0.1:43468 - "POST /node/69fe34ace4d4e78cd76b1d86 HTTP/1.0" 202 Accepted 2026-05-10 19:08:35,376 - lava_callback - INFO - Starting async job submit for node 69fe34ace4d4e78cd76b1d86 2026-05-10 19:08:35,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:08:35,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe34ace4d4e78cd76b1d86 HTTP/1.1" 200 None 2026-05-10 19:08:35,391 - lava_callback - DEBUG - Processing node 69fe34ace4d4e78cd76b1d86: baseline-arm-clabbe 2026-05-10 19:08:35,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe34ace4d4e78cd76b1d86 2026-05-10 19:08:35,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:08:35,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe34ace4d4e78cd76b1d86 HTTP/1.1" 200 None 2026-05-10 19:08:35,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:08:35,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:08:35,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:08:35,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe34ace4d4e78cd76b1d86 HTTP/1.1" 200 None 2026-05-10 19:08:35,444 - lava_callback - ERROR - Error processing callback for node 69fe34ace4d4e78cd76b1d86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 19:09:15,427 - lava_callback - INFO - Received callback for node 69fe34d2e4d4e78cd76b1d9b INFO: 172.21.0.1:39804 - "POST /node/69fe34d2e4d4e78cd76b1d9b HTTP/1.0" 202 Accepted 2026-05-10 19:09:15,433 - lava_callback - INFO - Starting async job submit for node 69fe34d2e4d4e78cd76b1d9b 2026-05-10 19:09:15,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:09:15,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe34d2e4d4e78cd76b1d9b HTTP/1.1" 200 None 2026-05-10 19:09:15,448 - lava_callback - DEBUG - Processing node 69fe34d2e4d4e78cd76b1d9b: baseline-arm-clabbe 2026-05-10 19:09:15,448 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe34d2e4d4e78cd76b1d9b 2026-05-10 19:09:15,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:09:15,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe34d2e4d4e78cd76b1d9b HTTP/1.1" 200 None 2026-05-10 19:09:15,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:09:15,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:09:15,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:09:15,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe34d2e4d4e78cd76b1d9b HTTP/1.1" 200 None 2026-05-10 19:09:15,509 - lava_callback - ERROR - Error processing callback for node 69fe34d2e4d4e78cd76b1d9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:09:55,417 - lava_callback - INFO - Received callback for node 69fe34f9e4d4e78cd76b1dba INFO: 172.21.0.1:49970 - "POST /node/69fe34f9e4d4e78cd76b1dba HTTP/1.0" 202 Accepted 2026-05-10 19:09:55,423 - lava_callback - INFO - Starting async job submit for node 69fe34f9e4d4e78cd76b1dba 2026-05-10 19:09:55,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:09:55,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe34f9e4d4e78cd76b1dba HTTP/1.1" 200 None 2026-05-10 19:09:55,445 - lava_callback - DEBUG - Processing node 69fe34f9e4d4e78cd76b1dba: baseline-arm-clabbe 2026-05-10 19:09:55,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe34f9e4d4e78cd76b1dba 2026-05-10 19:09:55,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:09:55,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe34f9e4d4e78cd76b1dba HTTP/1.1" 200 None 2026-05-10 19:09:55,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:09:55,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:09:55,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:09:55,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe34f9e4d4e78cd76b1dba HTTP/1.1" 200 None 2026-05-10 19:09:55,493 - lava_callback - ERROR - Error processing callback for node 69fe34f9e4d4e78cd76b1dba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:10:35,541 - lava_callback - INFO - Received callback for node 69fe3520e4d4e78cd76b1dca INFO: 172.21.0.1:42418 - "POST /node/69fe3520e4d4e78cd76b1dca HTTP/1.0" 202 Accepted 2026-05-10 19:10:35,546 - lava_callback - INFO - Starting async job submit for node 69fe3520e4d4e78cd76b1dca 2026-05-10 19:10:35,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:10:35,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3520e4d4e78cd76b1dca HTTP/1.1" 200 None 2026-05-10 19:10:35,562 - lava_callback - DEBUG - Processing node 69fe3520e4d4e78cd76b1dca: baseline-arm-clabbe 2026-05-10 19:10:35,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3520e4d4e78cd76b1dca 2026-05-10 19:10:35,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:10:35,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3520e4d4e78cd76b1dca HTTP/1.1" 200 None 2026-05-10 19:10:35,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:10:35,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:10:35,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:10:35,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3520e4d4e78cd76b1dca HTTP/1.1" 200 None 2026-05-10 19:10:35,620 - lava_callback - ERROR - Error processing callback for node 69fe3520e4d4e78cd76b1dca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:12:35,592 - lava_callback - INFO - Received callback for node 69fe3599e4d4e78cd76b1dfe INFO: 172.21.0.1:35292 - "POST /node/69fe3599e4d4e78cd76b1dfe HTTP/1.0" 202 Accepted 2026-05-10 19:12:35,598 - lava_callback - INFO - Starting async job submit for node 69fe3599e4d4e78cd76b1dfe 2026-05-10 19:12:35,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:12:35,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3599e4d4e78cd76b1dfe HTTP/1.1" 200 None 2026-05-10 19:12:35,614 - lava_callback - DEBUG - Processing node 69fe3599e4d4e78cd76b1dfe: baseline-arm-clabbe 2026-05-10 19:12:35,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3599e4d4e78cd76b1dfe 2026-05-10 19:12:35,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:12:35,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3599e4d4e78cd76b1dfe HTTP/1.1" 200 None 2026-05-10 19:12:35,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:12:35,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 19:12:35,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:12:35,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3599e4d4e78cd76b1dfe HTTP/1.1" 200 None 2026-05-10 19:12:35,669 - lava_callback - ERROR - Error processing callback for node 69fe3599e4d4e78cd76b1dfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET /node/69e5f39eab69ed7ddbbc44f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:31:17,928 - lava_callback - INFO - Received callback for node 69fe39f6e4d4e78cd76b1f60 INFO: 172.21.0.1:43190 - "POST /node/69fe39f6e4d4e78cd76b1f60 HTTP/1.0" 202 Accepted 2026-05-10 19:31:17,937 - lava_callback - INFO - Starting async job submit for node 69fe39f6e4d4e78cd76b1f60 2026-05-10 19:31:17,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:31:17,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe39f6e4d4e78cd76b1f60 HTTP/1.1" 200 None 2026-05-10 19:31:17,952 - lava_callback - DEBUG - Processing node 69fe39f6e4d4e78cd76b1f60: baseline-arm64-baylibre 2026-05-10 19:31:17,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe39f6e4d4e78cd76b1f60 2026-05-10 19:31:17,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:31:17,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe39f6e4d4e78cd76b1f60 HTTP/1.1" 200 None 2026-05-10 19:31:17,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:31:17,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 19:31:17,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:31:18,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe39f6e4d4e78cd76b1f60 HTTP/1.1" 200 None 2026-05-10 19:31:18,014 - lava_callback - ERROR - Error processing callback for node 69fe39f6e4d4e78cd76b1f60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:32:56,448 - lava_callback - INFO - Received callback for node 69fe3a51e4d4e78cd76b1f89 INFO: 172.21.0.1:54540 - "POST /node/69fe3a51e4d4e78cd76b1f89 HTTP/1.0" 202 Accepted 2026-05-10 19:32:56,454 - lava_callback - INFO - Starting async job submit for node 69fe3a51e4d4e78cd76b1f89 2026-05-10 19:32:56,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:32:56,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3a51e4d4e78cd76b1f89 HTTP/1.1" 200 None 2026-05-10 19:32:56,469 - lava_callback - DEBUG - Processing node 69fe3a51e4d4e78cd76b1f89: baseline-arm64-clabbe 2026-05-10 19:32:56,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3a51e4d4e78cd76b1f89 2026-05-10 19:32:56,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:32:56,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3a51e4d4e78cd76b1f89 HTTP/1.1" 200 None 2026-05-10 19:32:56,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:32:56,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 19:32:56,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:32:56,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3a51e4d4e78cd76b1f89 HTTP/1.1" 200 None 2026-05-10 19:32:56,524 - lava_callback - ERROR - Error processing callback for node 69fe3a51e4d4e78cd76b1f89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:34:16,507 - lava_callback - INFO - Received callback for node 69fe3ab2e4d4e78cd76b1fac INFO: 172.21.0.1:55846 - "POST /node/69fe3ab2e4d4e78cd76b1fac HTTP/1.0" 202 Accepted 2026-05-10 19:34:16,513 - lava_callback - INFO - Starting async job submit for node 69fe3ab2e4d4e78cd76b1fac 2026-05-10 19:34:16,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:34:16,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3ab2e4d4e78cd76b1fac HTTP/1.1" 200 None 2026-05-10 19:34:16,529 - lava_callback - DEBUG - Processing node 69fe3ab2e4d4e78cd76b1fac: baseline-arm64-clabbe 2026-05-10 19:34:16,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3ab2e4d4e78cd76b1fac 2026-05-10 19:34:16,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:34:16,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3ab2e4d4e78cd76b1fac HTTP/1.1" 200 None 2026-05-10 19:34:16,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:34:16,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 19:34:16,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:34:16,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3ab2e4d4e78cd76b1fac HTTP/1.1" 200 None 2026-05-10 19:34:16,587 - lava_callback - ERROR - Error processing callback for node 69fe3ab2e4d4e78cd76b1fac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:36:36,678 - lava_callback - INFO - Received callback for node 69fe3b34e4d4e78cd76b1fe6 INFO: 172.21.0.1:41596 - "POST /node/69fe3b34e4d4e78cd76b1fe6 HTTP/1.0" 202 Accepted 2026-05-10 19:36:36,684 - lava_callback - INFO - Starting async job submit for node 69fe3b34e4d4e78cd76b1fe6 2026-05-10 19:36:36,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:36:36,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3b34e4d4e78cd76b1fe6 HTTP/1.1" 200 None 2026-05-10 19:36:36,713 - lava_callback - DEBUG - Processing node 69fe3b34e4d4e78cd76b1fe6: baseline-arm64-clabbe 2026-05-10 19:36:36,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3b34e4d4e78cd76b1fe6 2026-05-10 19:36:36,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:36:36,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3b34e4d4e78cd76b1fe6 HTTP/1.1" 200 None 2026-05-10 19:36:36,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:36:36,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 19:36:36,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:36:36,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3b34e4d4e78cd76b1fe6 HTTP/1.1" 200 None 2026-05-10 19:36:36,805 - lava_callback - ERROR - Error processing callback for node 69fe3b34e4d4e78cd76b1fe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET /node/69862ad2177ca0f097bd21c8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:39:36,778 - lava_callback - INFO - Received callback for node 69fe3be8e4d4e78cd76b2023 INFO: 172.21.0.1:52636 - "POST /node/69fe3be8e4d4e78cd76b2023 HTTP/1.0" 202 Accepted 2026-05-10 19:39:36,783 - lava_callback - INFO - Starting async job submit for node 69fe3be8e4d4e78cd76b2023 2026-05-10 19:39:36,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:39:36,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3be8e4d4e78cd76b2023 HTTP/1.1" 200 None 2026-05-10 19:39:36,798 - lava_callback - DEBUG - Processing node 69fe3be8e4d4e78cd76b2023: baseline-arm64-clabbe 2026-05-10 19:39:36,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3be8e4d4e78cd76b2023 2026-05-10 19:39:36,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:39:36,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3be8e4d4e78cd76b2023 HTTP/1.1" 200 None 2026-05-10 19:39:36,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:39:36,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 19:39:36,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:39:36,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3be8e4d4e78cd76b2023 HTTP/1.1" 200 None 2026-05-10 19:39:36,873 - lava_callback - ERROR - Error processing callback for node 69fe3be8e4d4e78cd76b2023: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43378 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:42:36,879 - lava_callback - INFO - Received callback for node 69fe3c9ce4d4e78cd76b205d INFO: 172.21.0.1:43392 - "POST /node/69fe3c9ce4d4e78cd76b205d HTTP/1.0" 202 Accepted 2026-05-10 19:42:36,884 - lava_callback - INFO - Starting async job submit for node 69fe3c9ce4d4e78cd76b205d 2026-05-10 19:42:36,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:42:36,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3c9ce4d4e78cd76b205d HTTP/1.1" 200 None 2026-05-10 19:42:36,921 - lava_callback - DEBUG - Processing node 69fe3c9ce4d4e78cd76b205d: baseline-arm64-clabbe 2026-05-10 19:42:36,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3c9ce4d4e78cd76b205d 2026-05-10 19:42:36,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:42:36,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3c9ce4d4e78cd76b205d HTTP/1.1" 200 None 2026-05-10 19:42:36,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:42:36,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 19:42:36,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:42:36,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3c9ce4d4e78cd76b205d HTTP/1.1" 200 None 2026-05-10 19:42:36,993 - lava_callback - ERROR - Error processing callback for node 69fe3c9ce4d4e78cd76b205d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK 2026-05-10 19:45:56,954 - lava_callback - INFO - Received callback for node 69fe3d6ae4d4e78cd76b20c0 INFO: 172.21.0.1:33538 - "POST /node/69fe3d6ae4d4e78cd76b20c0 HTTP/1.0" 202 Accepted 2026-05-10 19:45:56,960 - lava_callback - INFO - Starting async job submit for node 69fe3d6ae4d4e78cd76b20c0 2026-05-10 19:45:56,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:45:56,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3d6ae4d4e78cd76b20c0 HTTP/1.1" 200 None 2026-05-10 19:45:56,975 - lava_callback - DEBUG - Processing node 69fe3d6ae4d4e78cd76b20c0: baseline-arm64-clabbe 2026-05-10 19:45:56,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe3d6ae4d4e78cd76b20c0 2026-05-10 19:45:56,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:45:56,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe3d6ae4d4e78cd76b20c0 HTTP/1.1" 200 None 2026-05-10 19:45:56,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:45:57,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 19:45:57,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 19:45:57,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe3d6ae4d4e78cd76b20c0 HTTP/1.1" 200 None 2026-05-10 19:45:57,039 - lava_callback - ERROR - Error processing callback for node 69fe3d6ae4d4e78cd76b20c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:39:12,113 - lava_callback - INFO - Received callback for node 69fe49dfe4d4e78cd76b21aa INFO: 172.21.0.1:50510 - "POST /node/69fe49dfe4d4e78cd76b21aa HTTP/1.0" 202 Accepted 2026-05-10 20:39:12,118 - lava_callback - INFO - Starting async job submit for node 69fe49dfe4d4e78cd76b21aa 2026-05-10 20:39:12,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:39:12,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe49dfe4d4e78cd76b21aa HTTP/1.1" 200 None 2026-05-10 20:39:12,133 - lava_callback - DEBUG - Processing node 69fe49dfe4d4e78cd76b21aa: baseline-x86 2026-05-10 20:39:12,134 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe49dfe4d4e78cd76b21aa 2026-05-10 20:39:12,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:39:12,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe49dfe4d4e78cd76b21aa HTTP/1.1" 200 None 2026-05-10 20:39:12,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:39:12,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9cbde98225c4a20469e0 HTTP/1.1" 200 None 2026-05-10 20:39:12,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:39:12,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe49dfe4d4e78cd76b21aa HTTP/1.1" 200 None 2026-05-10 20:39:12,194 - lava_callback - ERROR - Error processing callback for node 69fe49dfe4d4e78cd76b21aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:41:59,376 - lava_callback - INFO - Received callback for node 69fe4a82e4d4e78cd76b2212 INFO: 172.21.0.1:51648 - "POST /node/69fe4a82e4d4e78cd76b2212 HTTP/1.0" 202 Accepted 2026-05-10 20:41:59,381 - lava_callback - INFO - Starting async job submit for node 69fe4a82e4d4e78cd76b2212 2026-05-10 20:41:59,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:41:59,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4a82e4d4e78cd76b2212 HTTP/1.1" 200 None 2026-05-10 20:41:59,396 - lava_callback - DEBUG - Processing node 69fe4a82e4d4e78cd76b2212: baseline-arm-clabbe 2026-05-10 20:41:59,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4a82e4d4e78cd76b2212 2026-05-10 20:41:59,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:41:59,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4a82e4d4e78cd76b2212 HTTP/1.1" 200 None 2026-05-10 20:41:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:41:59,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-10 20:41:59,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:41:59,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4a82e4d4e78cd76b2212 HTTP/1.1" 200 None 2026-05-10 20:41:59,458 - lava_callback - ERROR - Error processing callback for node 69fe4a82e4d4e78cd76b2212: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:42:39,332 - lava_callback - INFO - Received callback for node 69fe4aa9e4d4e78cd76b222b INFO: 172.21.0.1:37654 - "POST /node/69fe4aa9e4d4e78cd76b222b HTTP/1.0" 202 Accepted 2026-05-10 20:42:39,337 - lava_callback - INFO - Starting async job submit for node 69fe4aa9e4d4e78cd76b222b 2026-05-10 20:42:39,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:42:39,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4aa9e4d4e78cd76b222b HTTP/1.1" 200 None 2026-05-10 20:42:39,359 - lava_callback - DEBUG - Processing node 69fe4aa9e4d4e78cd76b222b: baseline-arm-clabbe 2026-05-10 20:42:39,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4aa9e4d4e78cd76b222b 2026-05-10 20:42:39,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:42:39,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4aa9e4d4e78cd76b222b HTTP/1.1" 200 None 2026-05-10 20:42:39,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:42:39,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-10 20:42:39,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:42:39,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4aa9e4d4e78cd76b222b HTTP/1.1" 200 None 2026-05-10 20:42:39,403 - lava_callback - ERROR - Error processing callback for node 69fe4aa9e4d4e78cd76b222b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:42:59,379 - lava_callback - INFO - Received callback for node 69fe4ad0e4d4e78cd76b223d INFO: 172.21.0.1:51932 - "POST /node/69fe4ad0e4d4e78cd76b223d HTTP/1.0" 202 Accepted 2026-05-10 20:42:59,384 - lava_callback - INFO - Starting async job submit for node 69fe4ad0e4d4e78cd76b223d 2026-05-10 20:42:59,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:42:59,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4ad0e4d4e78cd76b223d HTTP/1.1" 200 None 2026-05-10 20:42:59,421 - lava_callback - DEBUG - Processing node 69fe4ad0e4d4e78cd76b223d: baseline-arm-clabbe 2026-05-10 20:42:59,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4ad0e4d4e78cd76b223d 2026-05-10 20:42:59,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:42:59,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4ad0e4d4e78cd76b223d HTTP/1.1" 200 None 2026-05-10 20:42:59,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:42:59,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-10 20:42:59,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:42:59,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4ad0e4d4e78cd76b223d HTTP/1.1" 200 None 2026-05-10 20:42:59,489 - lava_callback - ERROR - Error processing callback for node 69fe4ad0e4d4e78cd76b223d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:43:39,408 - lava_callback - INFO - Received callback for node 69fe4af7e4d4e78cd76b2258 INFO: 172.21.0.1:45650 - "POST /node/69fe4af7e4d4e78cd76b2258 HTTP/1.0" 202 Accepted 2026-05-10 20:43:39,414 - lava_callback - INFO - Starting async job submit for node 69fe4af7e4d4e78cd76b2258 2026-05-10 20:43:39,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:43:39,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4af7e4d4e78cd76b2258 HTTP/1.1" 200 None 2026-05-10 20:43:39,429 - lava_callback - DEBUG - Processing node 69fe4af7e4d4e78cd76b2258: baseline-arm-clabbe 2026-05-10 20:43:39,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4af7e4d4e78cd76b2258 2026-05-10 20:43:39,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:43:39,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4af7e4d4e78cd76b2258 HTTP/1.1" 200 None INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:43:39,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:43:39,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-10 20:43:39,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:43:39,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4af7e4d4e78cd76b2258 HTTP/1.1" 200 None 2026-05-10 20:43:39,480 - lava_callback - ERROR - Error processing callback for node 69fe4af7e4d4e78cd76b2258: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:44:19,441 - lava_callback - INFO - Received callback for node 69fe4b1ee4d4e78cd76b226a INFO: 172.21.0.1:35372 - "POST /node/69fe4b1ee4d4e78cd76b226a HTTP/1.0" 202 Accepted 2026-05-10 20:44:19,447 - lava_callback - INFO - Starting async job submit for node 69fe4b1ee4d4e78cd76b226a 2026-05-10 20:44:19,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:44:19,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4b1ee4d4e78cd76b226a HTTP/1.1" 200 None 2026-05-10 20:44:19,462 - lava_callback - DEBUG - Processing node 69fe4b1ee4d4e78cd76b226a: baseline-arm-clabbe 2026-05-10 20:44:19,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4b1ee4d4e78cd76b226a 2026-05-10 20:44:19,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:44:19,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4b1ee4d4e78cd76b226a HTTP/1.1" 200 None 2026-05-10 20:44:19,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:44:19,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-10 20:44:19,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:44:19,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4b1ee4d4e78cd76b226a HTTP/1.1" 200 None 2026-05-10 20:44:19,519 - lava_callback - ERROR - Error processing callback for node 69fe4b1ee4d4e78cd76b226a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:44:59,409 - lava_callback - INFO - Received callback for node 69fe4b45e4d4e78cd76b2286 INFO: 172.21.0.1:59212 - "POST /node/69fe4b45e4d4e78cd76b2286 HTTP/1.0" 202 Accepted 2026-05-10 20:44:59,415 - lava_callback - INFO - Starting async job submit for node 69fe4b45e4d4e78cd76b2286 2026-05-10 20:44:59,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:44:59,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4b45e4d4e78cd76b2286 HTTP/1.1" 200 None 2026-05-10 20:44:59,430 - lava_callback - DEBUG - Processing node 69fe4b45e4d4e78cd76b2286: baseline-arm-clabbe 2026-05-10 20:44:59,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4b45e4d4e78cd76b2286 2026-05-10 20:44:59,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:44:59,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4b45e4d4e78cd76b2286 HTTP/1.1" 200 None 2026-05-10 20:44:59,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:44:59,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-10 20:44:59,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:44:59,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4b45e4d4e78cd76b2286 HTTP/1.1" 200 None 2026-05-10 20:44:59,483 - lava_callback - ERROR - Error processing callback for node 69fe4b45e4d4e78cd76b2286: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:48:19,612 - lava_callback - INFO - Received callback for node 69fe4c0de4d4e78cd76b22a7 INFO: 172.21.0.1:50632 - "POST /node/69fe4c0de4d4e78cd76b22a7 HTTP/1.0" 202 Accepted 2026-05-10 20:48:19,618 - lava_callback - INFO - Starting async job submit for node 69fe4c0de4d4e78cd76b22a7 2026-05-10 20:48:19,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:48:19,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4c0de4d4e78cd76b22a7 HTTP/1.1" 200 None 2026-05-10 20:48:19,633 - lava_callback - DEBUG - Processing node 69fe4c0de4d4e78cd76b22a7: baseline-arm-clabbe 2026-05-10 20:48:19,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4c0de4d4e78cd76b22a7 2026-05-10 20:48:19,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:48:19,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4c0de4d4e78cd76b22a7 HTTP/1.1" 200 None 2026-05-10 20:48:19,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:48:19,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 20:48:19,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:48:19,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4c0de4d4e78cd76b22a7 HTTP/1.1" 200 None 2026-05-10 20:48:19,688 - lava_callback - ERROR - Error processing callback for node 69fe4c0de4d4e78cd76b22a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:48:59,586 - lava_callback - INFO - Received callback for node 69fe4c34e4d4e78cd76b22bf INFO: 172.21.0.1:47070 - "POST /node/69fe4c34e4d4e78cd76b22bf HTTP/1.0" 202 Accepted 2026-05-10 20:48:59,591 - lava_callback - INFO - Starting async job submit for node 69fe4c34e4d4e78cd76b22bf 2026-05-10 20:48:59,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:48:59,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4c34e4d4e78cd76b22bf HTTP/1.1" 200 None 2026-05-10 20:48:59,606 - lava_callback - DEBUG - Processing node 69fe4c34e4d4e78cd76b22bf: baseline-arm-clabbe 2026-05-10 20:48:59,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4c34e4d4e78cd76b22bf 2026-05-10 20:48:59,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:48:59,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4c34e4d4e78cd76b22bf HTTP/1.1" 200 None 2026-05-10 20:48:59,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:48:59,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 20:48:59,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:48:59,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4c34e4d4e78cd76b22bf HTTP/1.1" 200 None 2026-05-10 20:48:59,654 - lava_callback - ERROR - Error processing callback for node 69fe4c34e4d4e78cd76b22bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:49:39,710 - lava_callback - INFO - Received callback for node 69fe4c5de4d4e78cd76b22d5 INFO: 172.21.0.1:34514 - "POST /node/69fe4c5de4d4e78cd76b22d5 HTTP/1.0" 202 Accepted 2026-05-10 20:49:39,715 - lava_callback - INFO - Starting async job submit for node 69fe4c5de4d4e78cd76b22d5 2026-05-10 20:49:39,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:49:39,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4c5de4d4e78cd76b22d5 HTTP/1.1" 200 None 2026-05-10 20:49:39,731 - lava_callback - DEBUG - Processing node 69fe4c5de4d4e78cd76b22d5: baseline-arm-clabbe 2026-05-10 20:49:39,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4c5de4d4e78cd76b22d5 2026-05-10 20:49:39,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:49:39,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4c5de4d4e78cd76b22d5 HTTP/1.1" 200 None 2026-05-10 20:49:39,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:49:39,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 20:49:39,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:49:39,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4c5de4d4e78cd76b22d5 HTTP/1.1" 200 None 2026-05-10 20:49:39,786 - lava_callback - ERROR - Error processing callback for node 69fe4c5de4d4e78cd76b22d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET /node/6986fd4b6e077e4126a7d83c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:51:39,742 - lava_callback - INFO - Received callback for node 69fe4cd3e4d4e78cd76b2313 INFO: 172.21.0.1:49180 - "POST /node/69fe4cd3e4d4e78cd76b2313 HTTP/1.0" 202 Accepted 2026-05-10 20:51:39,747 - lava_callback - INFO - Starting async job submit for node 69fe4cd3e4d4e78cd76b2313 2026-05-10 20:51:39,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:51:39,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4cd3e4d4e78cd76b2313 HTTP/1.1" 200 None 2026-05-10 20:51:39,763 - lava_callback - DEBUG - Processing node 69fe4cd3e4d4e78cd76b2313: baseline-arm-clabbe 2026-05-10 20:51:39,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4cd3e4d4e78cd76b2313 2026-05-10 20:51:39,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:51:39,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4cd3e4d4e78cd76b2313 HTTP/1.1" 200 None 2026-05-10 20:51:39,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:51:39,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 20:51:39,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:51:39,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4cd3e4d4e78cd76b2313 HTTP/1.1" 200 None 2026-05-10 20:51:39,809 - lava_callback - ERROR - Error processing callback for node 69fe4cd3e4d4e78cd76b2313: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:52:19,733 - lava_callback - INFO - Received callback for node 69fe4cfae4d4e78cd76b2326 INFO: 172.21.0.1:37948 - "POST /node/69fe4cfae4d4e78cd76b2326 HTTP/1.0" 202 Accepted 2026-05-10 20:52:19,739 - lava_callback - INFO - Starting async job submit for node 69fe4cfae4d4e78cd76b2326 2026-05-10 20:52:19,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:52:19,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4cfae4d4e78cd76b2326 HTTP/1.1" 200 None 2026-05-10 20:52:19,760 - lava_callback - DEBUG - Processing node 69fe4cfae4d4e78cd76b2326: baseline-arm-clabbe 2026-05-10 20:52:19,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4cfae4d4e78cd76b2326 2026-05-10 20:52:19,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:52:19,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4cfae4d4e78cd76b2326 HTTP/1.1" 200 None 2026-05-10 20:52:19,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:52:19,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 20:52:19,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:52:19,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4cfae4d4e78cd76b2326 HTTP/1.1" 200 None 2026-05-10 20:52:19,806 - lava_callback - ERROR - Error processing callback for node 69fe4cfae4d4e78cd76b2326: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:54:19,837 - lava_callback - INFO - Received callback for node 69fe4d71e4d4e78cd76b2361 INFO: 172.21.0.1:48796 - "POST /node/69fe4d71e4d4e78cd76b2361 HTTP/1.0" 202 Accepted 2026-05-10 20:54:19,843 - lava_callback - INFO - Starting async job submit for node 69fe4d71e4d4e78cd76b2361 2026-05-10 20:54:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:54:19,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4d71e4d4e78cd76b2361 HTTP/1.1" 200 None 2026-05-10 20:54:19,860 - lava_callback - DEBUG - Processing node 69fe4d71e4d4e78cd76b2361: baseline-arm-clabbe 2026-05-10 20:54:19,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4d71e4d4e78cd76b2361 2026-05-10 20:54:19,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:54:19,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4d71e4d4e78cd76b2361 HTTP/1.1" 200 None 2026-05-10 20:54:19,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:54:19,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 20:54:19,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:54:19,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4d71e4d4e78cd76b2361 HTTP/1.1" 200 None 2026-05-10 20:54:19,904 - lava_callback - ERROR - Error processing callback for node 69fe4d71e4d4e78cd76b2361: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:57:42,597 - lava_callback - INFO - Received callback for node 69fe4e3de4d4e78cd76b23bb INFO: 172.21.0.1:58932 - "POST /node/69fe4e3de4d4e78cd76b23bb HTTP/1.0" 202 Accepted 2026-05-10 20:57:42,603 - lava_callback - INFO - Starting async job submit for node 69fe4e3de4d4e78cd76b23bb 2026-05-10 20:57:42,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:57:42,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4e3de4d4e78cd76b23bb HTTP/1.1" 200 None 2026-05-10 20:57:42,622 - lava_callback - DEBUG - Processing node 69fe4e3de4d4e78cd76b23bb: baseline-arm64-baylibre 2026-05-10 20:57:42,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4e3de4d4e78cd76b23bb 2026-05-10 20:57:42,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:57:42,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4e3de4d4e78cd76b23bb HTTP/1.1" 200 None 2026-05-10 20:57:42,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:57:42,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 20:57:42,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:57:42,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4e3de4d4e78cd76b23bb HTTP/1.1" 200 None 2026-05-10 20:57:42,674 - lava_callback - ERROR - Error processing callback for node 69fe4e3de4d4e78cd76b23bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK 2026-05-10 20:59:02,536 - lava_callback - INFO - Received callback for node 69fe4e8de4d4e78cd76b23dd INFO: 172.21.0.1:35738 - "POST /node/69fe4e8de4d4e78cd76b23dd HTTP/1.0" 202 Accepted 2026-05-10 20:59:02,541 - lava_callback - INFO - Starting async job submit for node 69fe4e8de4d4e78cd76b23dd 2026-05-10 20:59:02,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:59:02,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4e8de4d4e78cd76b23dd HTTP/1.1" 200 None 2026-05-10 20:59:02,576 - lava_callback - DEBUG - Processing node 69fe4e8de4d4e78cd76b23dd: baseline-arm64-baylibre 2026-05-10 20:59:02,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4e8de4d4e78cd76b23dd 2026-05-10 20:59:02,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:59:02,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4e8de4d4e78cd76b23dd HTTP/1.1" 200 None 2026-05-10 20:59:02,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:59:02,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 20:59:02,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 20:59:02,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4e8de4d4e78cd76b23dd HTTP/1.1" 200 None 2026-05-10 20:59:02,663 - lava_callback - ERROR - Error processing callback for node 69fe4e8de4d4e78cd76b23dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:00:22,605 - lava_callback - INFO - Received callback for node 69fe4ee1e4d4e78cd76b2405 INFO: 172.21.0.1:52068 - "POST /node/69fe4ee1e4d4e78cd76b2405 HTTP/1.0" 202 Accepted 2026-05-10 21:00:22,610 - lava_callback - INFO - Starting async job submit for node 69fe4ee1e4d4e78cd76b2405 2026-05-10 21:00:22,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:00:22,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4ee1e4d4e78cd76b2405 HTTP/1.1" 200 None 2026-05-10 21:00:22,625 - lava_callback - DEBUG - Processing node 69fe4ee1e4d4e78cd76b2405: baseline-arm64-baylibre 2026-05-10 21:00:22,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4ee1e4d4e78cd76b2405 2026-05-10 21:00:22,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:00:22,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4ee1e4d4e78cd76b2405 HTTP/1.1" 200 None 2026-05-10 21:00:22,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:00:22,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:00:22,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:00:22,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4ee1e4d4e78cd76b2405 HTTP/1.1" 200 None 2026-05-10 21:00:22,670 - lava_callback - ERROR - Error processing callback for node 69fe4ee1e4d4e78cd76b2405: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:01:42,750 - lava_callback - INFO - Received callback for node 69fe4f32e4d4e78cd76b2421 INFO: 172.21.0.1:35322 - "POST /node/69fe4f32e4d4e78cd76b2421 HTTP/1.0" 202 Accepted 2026-05-10 21:01:42,756 - lava_callback - INFO - Starting async job submit for node 69fe4f32e4d4e78cd76b2421 2026-05-10 21:01:42,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:01:42,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4f32e4d4e78cd76b2421 HTTP/1.1" 200 None 2026-05-10 21:01:42,782 - lava_callback - DEBUG - Processing node 69fe4f32e4d4e78cd76b2421: baseline-arm64-baylibre 2026-05-10 21:01:42,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4f32e4d4e78cd76b2421 2026-05-10 21:01:42,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:01:42,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4f32e4d4e78cd76b2421 HTTP/1.1" 200 None 2026-05-10 21:01:42,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:01:42,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:01:42,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:01:42,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4f32e4d4e78cd76b2421 HTTP/1.1" 200 None 2026-05-10 21:01:42,834 - lava_callback - ERROR - Error processing callback for node 69fe4f32e4d4e78cd76b2421: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:03:02,792 - lava_callback - INFO - Received callback for node 69fe4f84e4d4e78cd76b2446 INFO: 172.21.0.1:49054 - "POST /node/69fe4f84e4d4e78cd76b2446 HTTP/1.0" 202 Accepted 2026-05-10 21:03:02,798 - lava_callback - INFO - Starting async job submit for node 69fe4f84e4d4e78cd76b2446 2026-05-10 21:03:02,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:03:02,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4f84e4d4e78cd76b2446 HTTP/1.1" 200 None 2026-05-10 21:03:02,813 - lava_callback - DEBUG - Processing node 69fe4f84e4d4e78cd76b2446: baseline-arm64-baylibre 2026-05-10 21:03:02,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4f84e4d4e78cd76b2446 2026-05-10 21:03:02,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:03:02,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4f84e4d4e78cd76b2446 HTTP/1.1" 200 None 2026-05-10 21:03:02,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:03:02,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:03:02,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:03:02,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4f84e4d4e78cd76b2446 HTTP/1.1" 200 None 2026-05-10 21:03:02,889 - lava_callback - ERROR - Error processing callback for node 69fe4f84e4d4e78cd76b2446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:04:42,833 - lava_callback - INFO - Received callback for node 69fe4fd8e4d4e78cd76b246f INFO: 172.21.0.1:41060 - "POST /node/69fe4fd8e4d4e78cd76b246f HTTP/1.0" 202 Accepted 2026-05-10 21:04:42,839 - lava_callback - INFO - Starting async job submit for node 69fe4fd8e4d4e78cd76b246f 2026-05-10 21:04:42,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:04:42,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4fd8e4d4e78cd76b246f HTTP/1.1" 200 None 2026-05-10 21:04:42,854 - lava_callback - DEBUG - Processing node 69fe4fd8e4d4e78cd76b246f: baseline-arm64-baylibre 2026-05-10 21:04:42,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe4fd8e4d4e78cd76b246f 2026-05-10 21:04:42,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:04:42,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe4fd8e4d4e78cd76b246f HTTP/1.1" 200 None 2026-05-10 21:04:42,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:04:42,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:04:42,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:04:42,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe4fd8e4d4e78cd76b246f HTTP/1.1" 200 None 2026-05-10 21:04:42,900 - lava_callback - ERROR - Error processing callback for node 69fe4fd8e4d4e78cd76b246f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET /node/685d049a6e9add64ba7d207d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:08:43,146 - lava_callback - INFO - Received callback for node 69fe50cde4d4e78cd76b24ed INFO: 172.21.0.1:32950 - "POST /node/69fe50cde4d4e78cd76b24ed HTTP/1.0" 202 Accepted 2026-05-10 21:08:43,152 - lava_callback - INFO - Starting async job submit for node 69fe50cde4d4e78cd76b24ed 2026-05-10 21:08:43,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:08:43,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe50cde4d4e78cd76b24ed HTTP/1.1" 200 None 2026-05-10 21:08:43,168 - lava_callback - DEBUG - Processing node 69fe50cde4d4e78cd76b24ed: baseline-arm64-baylibre 2026-05-10 21:08:43,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe50cde4d4e78cd76b24ed 2026-05-10 21:08:43,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:08:43,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe50cde4d4e78cd76b24ed HTTP/1.1" 200 None 2026-05-10 21:08:43,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:08:43,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:08:43,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:08:43,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe50cde4d4e78cd76b24ed HTTP/1.1" 200 None 2026-05-10 21:08:43,214 - lava_callback - ERROR - Error processing callback for node 69fe50cde4d4e78cd76b24ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:10:03,199 - lava_callback - INFO - Received callback for node 69fe5120e4d4e78cd76b250f INFO: 172.21.0.1:40766 - "POST /node/69fe5120e4d4e78cd76b250f HTTP/1.0" 202 Accepted 2026-05-10 21:10:03,205 - lava_callback - INFO - Starting async job submit for node 69fe5120e4d4e78cd76b250f 2026-05-10 21:10:03,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:10:03,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5120e4d4e78cd76b250f HTTP/1.1" 200 None 2026-05-10 21:10:03,265 - lava_callback - DEBUG - Processing node 69fe5120e4d4e78cd76b250f: baseline-arm64-baylibre 2026-05-10 21:10:03,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5120e4d4e78cd76b250f 2026-05-10 21:10:03,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:10:03,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5120e4d4e78cd76b250f HTTP/1.1" 200 None 2026-05-10 21:10:03,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:10:03,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:10:03,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:10:03,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5120e4d4e78cd76b250f HTTP/1.1" 200 None 2026-05-10 21:10:03,436 - lava_callback - ERROR - Error processing callback for node 69fe5120e4d4e78cd76b250f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:11:23,230 - lava_callback - INFO - Received callback for node 69fe5171e4d4e78cd76b252f INFO: 172.21.0.1:52040 - "POST /node/69fe5171e4d4e78cd76b252f HTTP/1.0" 202 Accepted 2026-05-10 21:11:23,235 - lava_callback - INFO - Starting async job submit for node 69fe5171e4d4e78cd76b252f 2026-05-10 21:11:23,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:11:23,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5171e4d4e78cd76b252f HTTP/1.1" 200 None 2026-05-10 21:11:23,263 - lava_callback - DEBUG - Processing node 69fe5171e4d4e78cd76b252f: baseline-arm64-baylibre 2026-05-10 21:11:23,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5171e4d4e78cd76b252f 2026-05-10 21:11:23,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:11:23,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5171e4d4e78cd76b252f HTTP/1.1" 200 None 2026-05-10 21:11:23,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:11:23,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:11:23,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:11:23,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5171e4d4e78cd76b252f HTTP/1.1" 200 None 2026-05-10 21:11:23,307 - lava_callback - ERROR - Error processing callback for node 69fe5171e4d4e78cd76b252f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET /node/69848a913a8748f282087942%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:12:43,322 - lava_callback - INFO - Received callback for node 69fe51c5e4d4e78cd76b2552 INFO: 172.21.0.1:54496 - "POST /node/69fe51c5e4d4e78cd76b2552 HTTP/1.0" 202 Accepted 2026-05-10 21:12:43,328 - lava_callback - INFO - Starting async job submit for node 69fe51c5e4d4e78cd76b2552 2026-05-10 21:12:43,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:12:43,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe51c5e4d4e78cd76b2552 HTTP/1.1" 200 None 2026-05-10 21:12:43,343 - lava_callback - DEBUG - Processing node 69fe51c5e4d4e78cd76b2552: baseline-arm64-baylibre 2026-05-10 21:12:43,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe51c5e4d4e78cd76b2552 2026-05-10 21:12:43,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:12:43,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe51c5e4d4e78cd76b2552 HTTP/1.1" 200 None 2026-05-10 21:12:43,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:12:43,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:12:43,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:12:43,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe51c5e4d4e78cd76b2552 HTTP/1.1" 200 None 2026-05-10 21:12:43,455 - lava_callback - ERROR - Error processing callback for node 69fe51c5e4d4e78cd76b2552: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:14:03,438 - lava_callback - INFO - Received callback for node 69fe5216e4d4e78cd76b2575 INFO: 172.21.0.1:34424 - "POST /node/69fe5216e4d4e78cd76b2575 HTTP/1.0" 202 Accepted 2026-05-10 21:14:03,444 - lava_callback - INFO - Starting async job submit for node 69fe5216e4d4e78cd76b2575 2026-05-10 21:14:03,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:14:03,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5216e4d4e78cd76b2575 HTTP/1.1" 200 None 2026-05-10 21:14:03,459 - lava_callback - DEBUG - Processing node 69fe5216e4d4e78cd76b2575: baseline-arm64-baylibre 2026-05-10 21:14:03,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5216e4d4e78cd76b2575 2026-05-10 21:14:03,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:14:03,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5216e4d4e78cd76b2575 HTTP/1.1" 200 None 2026-05-10 21:14:03,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:14:03,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:14:03,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:14:03,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5216e4d4e78cd76b2575 HTTP/1.1" 200 None 2026-05-10 21:14:03,506 - lava_callback - ERROR - Error processing callback for node 69fe5216e4d4e78cd76b2575: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:15:23,486 - lava_callback - INFO - Received callback for node 69fe5267e4d4e78cd76b259f INFO: 172.21.0.1:45728 - "POST /node/69fe5267e4d4e78cd76b259f HTTP/1.0" 202 Accepted 2026-05-10 21:15:23,492 - lava_callback - INFO - Starting async job submit for node 69fe5267e4d4e78cd76b259f 2026-05-10 21:15:23,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:15:23,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5267e4d4e78cd76b259f HTTP/1.1" 200 None 2026-05-10 21:15:23,507 - lava_callback - DEBUG - Processing node 69fe5267e4d4e78cd76b259f: baseline-arm64-baylibre 2026-05-10 21:15:23,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5267e4d4e78cd76b259f 2026-05-10 21:15:23,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:15:23,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5267e4d4e78cd76b259f HTTP/1.1" 200 None 2026-05-10 21:15:23,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:15:23,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:15:23,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:15:23,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5267e4d4e78cd76b259f HTTP/1.1" 200 None 2026-05-10 21:15:23,563 - lava_callback - ERROR - Error processing callback for node 69fe5267e4d4e78cd76b259f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET /node/68ed3181b7d29d6f63c901e8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:17:00,712 - lava_callback - INFO - Received callback for node 69fe52c0e4d4e78cd76b25c9 INFO: 172.21.0.1:44284 - "POST /node/69fe52c0e4d4e78cd76b25c9 HTTP/1.0" 202 Accepted 2026-05-10 21:17:00,717 - lava_callback - INFO - Starting async job submit for node 69fe52c0e4d4e78cd76b25c9 2026-05-10 21:17:00,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:17:00,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe52c0e4d4e78cd76b25c9 HTTP/1.1" 200 None 2026-05-10 21:17:00,737 - lava_callback - DEBUG - Processing node 69fe52c0e4d4e78cd76b25c9: baseline-arm64-clabbe 2026-05-10 21:17:00,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe52c0e4d4e78cd76b25c9 2026-05-10 21:17:00,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:17:00,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe52c0e4d4e78cd76b25c9 HTTP/1.1" 200 None 2026-05-10 21:17:00,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:17:00,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:17:00,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:17:00,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe52c0e4d4e78cd76b25c9 HTTP/1.1" 200 None 2026-05-10 21:17:00,789 - lava_callback - ERROR - Error processing callback for node 69fe52c0e4d4e78cd76b25c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET /node/697ab1c079032e239ba0fd5d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:18:20,726 - lava_callback - INFO - Received callback for node 69fe5312e4d4e78cd76b25e3 INFO: 172.21.0.1:39360 - "POST /node/69fe5312e4d4e78cd76b25e3 HTTP/1.0" 202 Accepted 2026-05-10 21:18:20,731 - lava_callback - INFO - Starting async job submit for node 69fe5312e4d4e78cd76b25e3 2026-05-10 21:18:20,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:18:20,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5312e4d4e78cd76b25e3 HTTP/1.1" 200 None 2026-05-10 21:18:20,747 - lava_callback - DEBUG - Processing node 69fe5312e4d4e78cd76b25e3: baseline-arm64-clabbe 2026-05-10 21:18:20,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5312e4d4e78cd76b25e3 2026-05-10 21:18:20,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:18:20,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5312e4d4e78cd76b25e3 HTTP/1.1" 200 None 2026-05-10 21:18:20,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:18:20,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:18:20,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:18:20,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5312e4d4e78cd76b25e3 HTTP/1.1" 200 None 2026-05-10 21:18:20,794 - lava_callback - ERROR - Error processing callback for node 69fe5312e4d4e78cd76b25e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:19:40,789 - lava_callback - INFO - Received callback for node 69fe5363e4d4e78cd76b2609 INFO: 172.21.0.1:46526 - "POST /node/69fe5363e4d4e78cd76b2609 HTTP/1.0" 202 Accepted 2026-05-10 21:19:40,794 - lava_callback - INFO - Starting async job submit for node 69fe5363e4d4e78cd76b2609 2026-05-10 21:19:40,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:19:40,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5363e4d4e78cd76b2609 HTTP/1.1" 200 None 2026-05-10 21:19:40,810 - lava_callback - DEBUG - Processing node 69fe5363e4d4e78cd76b2609: baseline-arm64-clabbe 2026-05-10 21:19:40,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5363e4d4e78cd76b2609 2026-05-10 21:19:40,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:19:40,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5363e4d4e78cd76b2609 HTTP/1.1" 200 None 2026-05-10 21:19:40,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:19:40,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:19:40,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:19:40,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5363e4d4e78cd76b2609 HTTP/1.1" 200 None 2026-05-10 21:19:40,854 - lava_callback - ERROR - Error processing callback for node 69fe5363e4d4e78cd76b2609: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:21:00,859 - lava_callback - INFO - Received callback for node 69fe53b5e4d4e78cd76b2635 INFO: 172.21.0.1:38736 - "POST /node/69fe53b5e4d4e78cd76b2635 HTTP/1.0" 202 Accepted 2026-05-10 21:21:00,864 - lava_callback - INFO - Starting async job submit for node 69fe53b5e4d4e78cd76b2635 2026-05-10 21:21:00,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:21:00,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe53b5e4d4e78cd76b2635 HTTP/1.1" 200 None 2026-05-10 21:21:00,887 - lava_callback - DEBUG - Processing node 69fe53b5e4d4e78cd76b2635: baseline-arm64-clabbe 2026-05-10 21:21:00,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe53b5e4d4e78cd76b2635 2026-05-10 21:21:00,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:21:00,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe53b5e4d4e78cd76b2635 HTTP/1.1" 200 None 2026-05-10 21:21:00,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:21:00,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:21:00,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:21:00,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe53b5e4d4e78cd76b2635 HTTP/1.1" 200 None 2026-05-10 21:21:00,933 - lava_callback - ERROR - Error processing callback for node 69fe53b5e4d4e78cd76b2635: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:22:20,864 - lava_callback - INFO - Received callback for node 69fe5406e4d4e78cd76b2655 INFO: 172.21.0.1:42600 - "POST /node/69fe5406e4d4e78cd76b2655 HTTP/1.0" 202 Accepted 2026-05-10 21:22:20,870 - lava_callback - INFO - Starting async job submit for node 69fe5406e4d4e78cd76b2655 2026-05-10 21:22:20,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:22:20,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5406e4d4e78cd76b2655 HTTP/1.1" 200 None 2026-05-10 21:22:20,892 - lava_callback - DEBUG - Processing node 69fe5406e4d4e78cd76b2655: baseline-arm64-clabbe 2026-05-10 21:22:20,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5406e4d4e78cd76b2655 2026-05-10 21:22:20,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:22:20,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5406e4d4e78cd76b2655 HTTP/1.1" 200 None 2026-05-10 21:22:20,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:22:20,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:22:20,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:22:20,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5406e4d4e78cd76b2655 HTTP/1.1" 200 None 2026-05-10 21:22:20,946 - lava_callback - ERROR - Error processing callback for node 69fe5406e4d4e78cd76b2655: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:23:40,958 - lava_callback - INFO - Received callback for node 69fe5457e4d4e78cd76b2686 INFO: 172.21.0.1:35840 - "POST /node/69fe5457e4d4e78cd76b2686 HTTP/1.0" 202 Accepted 2026-05-10 21:23:40,968 - lava_callback - INFO - Starting async job submit for node 69fe5457e4d4e78cd76b2686 2026-05-10 21:23:40,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:23:40,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5457e4d4e78cd76b2686 HTTP/1.1" 200 None 2026-05-10 21:23:40,985 - lava_callback - DEBUG - Processing node 69fe5457e4d4e78cd76b2686: baseline-arm64-clabbe 2026-05-10 21:23:40,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5457e4d4e78cd76b2686 2026-05-10 21:23:40,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:23:41,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5457e4d4e78cd76b2686 HTTP/1.1" 200 None 2026-05-10 21:23:41,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:23:41,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-10 21:23:41,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:23:41,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5457e4d4e78cd76b2686 HTTP/1.1" 200 None 2026-05-10 21:23:41,046 - lava_callback - ERROR - Error processing callback for node 69fe5457e4d4e78cd76b2686: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:25:00,999 - lava_callback - INFO - Received callback for node 69fe54aae4d4e78cd76b26ab INFO: 172.21.0.1:56480 - "POST /node/69fe54aae4d4e78cd76b26ab HTTP/1.0" 202 Accepted 2026-05-10 21:25:01,006 - lava_callback - INFO - Starting async job submit for node 69fe54aae4d4e78cd76b26ab 2026-05-10 21:25:01,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:25:01,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe54aae4d4e78cd76b26ab HTTP/1.1" 200 None 2026-05-10 21:25:01,023 - lava_callback - DEBUG - Processing node 69fe54aae4d4e78cd76b26ab: baseline-arm64-clabbe 2026-05-10 21:25:01,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe54aae4d4e78cd76b26ab 2026-05-10 21:25:01,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:25:01,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe54aae4d4e78cd76b26ab HTTP/1.1" 200 None 2026-05-10 21:25:01,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:25:01,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:25:01,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:25:01,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe54aae4d4e78cd76b26ab HTTP/1.1" 200 None 2026-05-10 21:25:01,083 - lava_callback - ERROR - Error processing callback for node 69fe54aae4d4e78cd76b26ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49946 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:26:41,058 - lava_callback - INFO - Received callback for node 69fe54fde4d4e78cd76b26e2 INFO: 172.21.0.1:49956 - "POST /node/69fe54fde4d4e78cd76b26e2 HTTP/1.0" 202 Accepted 2026-05-10 21:26:41,063 - lava_callback - INFO - Starting async job submit for node 69fe54fde4d4e78cd76b26e2 2026-05-10 21:26:41,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:26:41,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe54fde4d4e78cd76b26e2 HTTP/1.1" 200 None 2026-05-10 21:26:41,079 - lava_callback - DEBUG - Processing node 69fe54fde4d4e78cd76b26e2: baseline-arm64-clabbe 2026-05-10 21:26:41,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe54fde4d4e78cd76b26e2 2026-05-10 21:26:41,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:26:41,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe54fde4d4e78cd76b26e2 HTTP/1.1" 200 None 2026-05-10 21:26:41,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:26:41,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:26:41,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:26:41,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe54fde4d4e78cd76b26e2 HTTP/1.1" 200 None 2026-05-10 21:26:41,126 - lava_callback - ERROR - Error processing callback for node 69fe54fde4d4e78cd76b26e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:28:01,127 - lava_callback - INFO - Received callback for node 69fe554fe4d4e78cd76b2702 INFO: 172.21.0.1:46386 - "POST /node/69fe554fe4d4e78cd76b2702 HTTP/1.0" 202 Accepted 2026-05-10 21:28:01,133 - lava_callback - INFO - Starting async job submit for node 69fe554fe4d4e78cd76b2702 2026-05-10 21:28:01,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:28:01,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe554fe4d4e78cd76b2702 HTTP/1.1" 200 None 2026-05-10 21:28:01,149 - lava_callback - DEBUG - Processing node 69fe554fe4d4e78cd76b2702: baseline-arm64-clabbe 2026-05-10 21:28:01,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe554fe4d4e78cd76b2702 2026-05-10 21:28:01,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:28:01,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe554fe4d4e78cd76b2702 HTTP/1.1" 200 None 2026-05-10 21:28:01,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:28:01,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:28:01,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:28:01,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe554fe4d4e78cd76b2702 HTTP/1.1" 200 None 2026-05-10 21:28:01,223 - lava_callback - ERROR - Error processing callback for node 69fe554fe4d4e78cd76b2702: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37320 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:29:21,186 - lava_callback - INFO - Received callback for node 69fe55a2e4d4e78cd76b272f INFO: 172.21.0.1:42530 - "POST /node/69fe55a2e4d4e78cd76b272f HTTP/1.0" 202 Accepted 2026-05-10 21:29:21,192 - lava_callback - INFO - Starting async job submit for node 69fe55a2e4d4e78cd76b272f 2026-05-10 21:29:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:29:21,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe55a2e4d4e78cd76b272f HTTP/1.1" 200 None 2026-05-10 21:29:21,207 - lava_callback - DEBUG - Processing node 69fe55a2e4d4e78cd76b272f: baseline-arm64-clabbe 2026-05-10 21:29:21,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe55a2e4d4e78cd76b272f 2026-05-10 21:29:21,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:29:21,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe55a2e4d4e78cd76b272f HTTP/1.1" 200 None 2026-05-10 21:29:21,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:29:21,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:29:21,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:29:21,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe55a2e4d4e78cd76b272f HTTP/1.1" 200 None 2026-05-10 21:29:21,255 - lava_callback - ERROR - Error processing callback for node 69fe55a2e4d4e78cd76b272f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:31:01,257 - lava_callback - INFO - Received callback for node 69fe560fe4d4e78cd76b276b INFO: 172.21.0.1:46804 - "POST /node/69fe560fe4d4e78cd76b276b HTTP/1.0" 202 Accepted 2026-05-10 21:31:01,262 - lava_callback - INFO - Starting async job submit for node 69fe560fe4d4e78cd76b276b 2026-05-10 21:31:01,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:31:01,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe560fe4d4e78cd76b276b HTTP/1.1" 200 None 2026-05-10 21:31:01,278 - lava_callback - DEBUG - Processing node 69fe560fe4d4e78cd76b276b: baseline-arm64-clabbe 2026-05-10 21:31:01,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe560fe4d4e78cd76b276b 2026-05-10 21:31:01,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:31:01,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe560fe4d4e78cd76b276b HTTP/1.1" 200 None 2026-05-10 21:31:01,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:31:01,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:31:01,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:31:01,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe560fe4d4e78cd76b276b HTTP/1.1" 200 None 2026-05-10 21:31:01,322 - lava_callback - ERROR - Error processing callback for node 69fe560fe4d4e78cd76b276b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:32:21,271 - lava_callback - INFO - Received callback for node 69fe565fe4d4e78cd76b278a INFO: 172.21.0.1:54880 - "POST /node/69fe565fe4d4e78cd76b278a HTTP/1.0" 202 Accepted 2026-05-10 21:32:21,277 - lava_callback - INFO - Starting async job submit for node 69fe565fe4d4e78cd76b278a 2026-05-10 21:32:21,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:32:21,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe565fe4d4e78cd76b278a HTTP/1.1" 200 None 2026-05-10 21:32:21,300 - lava_callback - DEBUG - Processing node 69fe565fe4d4e78cd76b278a: baseline-arm64-clabbe 2026-05-10 21:32:21,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe565fe4d4e78cd76b278a 2026-05-10 21:32:21,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:32:21,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe565fe4d4e78cd76b278a HTTP/1.1" 200 None 2026-05-10 21:32:21,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:32:21,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-10 21:32:21,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:32:21,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe565fe4d4e78cd76b278a HTTP/1.1" 200 None 2026-05-10 21:32:21,352 - lava_callback - ERROR - Error processing callback for node 69fe565fe4d4e78cd76b278a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:33:41,366 - lava_callback - INFO - Received callback for node 69fe56a3e4d4e78cd76b27b4 INFO: 172.21.0.1:56600 - "POST /node/69fe56a3e4d4e78cd76b27b4 HTTP/1.0" 202 Accepted 2026-05-10 21:33:41,376 - lava_callback - INFO - Starting async job submit for node 69fe56a3e4d4e78cd76b27b4 2026-05-10 21:33:41,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:33:41,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe56a3e4d4e78cd76b27b4 HTTP/1.1" 200 None 2026-05-10 21:33:41,392 - lava_callback - DEBUG - Processing node 69fe56a3e4d4e78cd76b27b4: baseline-arm-clabbe 2026-05-10 21:33:41,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe56a3e4d4e78cd76b27b4 2026-05-10 21:33:41,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:33:41,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe56a3e4d4e78cd76b27b4 HTTP/1.1" 200 None 2026-05-10 21:33:41,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:33:41,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:33:41,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:33:41,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe56a3e4d4e78cd76b27b4 HTTP/1.1" 200 None 2026-05-10 21:33:41,451 - lava_callback - ERROR - Error processing callback for node 69fe56a3e4d4e78cd76b27b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:34:21,373 - lava_callback - INFO - Received callback for node 69fe56c8e4d4e78cd76b27ce INFO: 172.21.0.1:48116 - "POST /node/69fe56c8e4d4e78cd76b27ce HTTP/1.0" 202 Accepted 2026-05-10 21:34:21,378 - lava_callback - INFO - Starting async job submit for node 69fe56c8e4d4e78cd76b27ce 2026-05-10 21:34:21,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:34:21,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe56c8e4d4e78cd76b27ce HTTP/1.1" 200 None 2026-05-10 21:34:21,393 - lava_callback - DEBUG - Processing node 69fe56c8e4d4e78cd76b27ce: baseline-arm-clabbe 2026-05-10 21:34:21,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe56c8e4d4e78cd76b27ce 2026-05-10 21:34:21,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:34:21,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe56c8e4d4e78cd76b27ce HTTP/1.1" 200 None 2026-05-10 21:34:21,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:34:21,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:34:21,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:34:21,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe56c8e4d4e78cd76b27ce HTTP/1.1" 200 None 2026-05-10 21:34:21,439 - lava_callback - ERROR - Error processing callback for node 69fe56c8e4d4e78cd76b27ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:34:41,421 - lava_callback - INFO - Received callback for node 69fe56ede4d4e78cd76b27f4 INFO: 172.21.0.1:45898 - "POST /node/69fe56ede4d4e78cd76b27f4 HTTP/1.0" 202 Accepted 2026-05-10 21:34:41,431 - lava_callback - INFO - Starting async job submit for node 69fe56ede4d4e78cd76b27f4 2026-05-10 21:34:41,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:34:41,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe56ede4d4e78cd76b27f4 HTTP/1.1" 200 None 2026-05-10 21:34:41,454 - lava_callback - DEBUG - Processing node 69fe56ede4d4e78cd76b27f4: baseline-arm-clabbe 2026-05-10 21:34:41,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe56ede4d4e78cd76b27f4 2026-05-10 21:34:41,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:34:41,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe56ede4d4e78cd76b27f4 HTTP/1.1" 200 None 2026-05-10 21:34:41,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:34:41,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:34:41,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:34:41,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe56ede4d4e78cd76b27f4 HTTP/1.1" 200 None 2026-05-10 21:34:41,509 - lava_callback - ERROR - Error processing callback for node 69fe56ede4d4e78cd76b27f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:35:21,414 - lava_callback - INFO - Received callback for node 69fe5710e4d4e78cd76b2806 INFO: 172.21.0.1:54906 - "POST /node/69fe5710e4d4e78cd76b2806 HTTP/1.0" 202 Accepted 2026-05-10 21:35:21,420 - lava_callback - INFO - Starting async job submit for node 69fe5710e4d4e78cd76b2806 2026-05-10 21:35:21,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:35:21,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5710e4d4e78cd76b2806 HTTP/1.1" 200 None 2026-05-10 21:35:21,436 - lava_callback - DEBUG - Processing node 69fe5710e4d4e78cd76b2806: baseline-arm-clabbe 2026-05-10 21:35:21,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5710e4d4e78cd76b2806 2026-05-10 21:35:21,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:35:21,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5710e4d4e78cd76b2806 HTTP/1.1" 200 None 2026-05-10 21:35:21,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:35:21,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:35:21,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:35:21,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5710e4d4e78cd76b2806 HTTP/1.1" 200 None 2026-05-10 21:35:21,484 - lava_callback - ERROR - Error processing callback for node 69fe5710e4d4e78cd76b2806: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:36:01,463 - lava_callback - INFO - Received callback for node 69fe5735e4d4e78cd76b2825 INFO: 172.21.0.1:52644 - "POST /node/69fe5735e4d4e78cd76b2825 HTTP/1.0" 202 Accepted 2026-05-10 21:36:01,468 - lava_callback - INFO - Starting async job submit for node 69fe5735e4d4e78cd76b2825 2026-05-10 21:36:01,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:36:01,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5735e4d4e78cd76b2825 HTTP/1.1" 200 None 2026-05-10 21:36:01,486 - lava_callback - DEBUG - Processing node 69fe5735e4d4e78cd76b2825: baseline-arm-clabbe 2026-05-10 21:36:01,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5735e4d4e78cd76b2825 2026-05-10 21:36:01,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:36:01,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5735e4d4e78cd76b2825 HTTP/1.1" 200 None 2026-05-10 21:36:01,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:36:01,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:36:01,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:36:01,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5735e4d4e78cd76b2825 HTTP/1.1" 200 None 2026-05-10 21:36:01,542 - lava_callback - ERROR - Error processing callback for node 69fe5735e4d4e78cd76b2825: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:36:41,455 - lava_callback - INFO - Received callback for node 69fe575ae4d4e78cd76b2839 INFO: 172.21.0.1:54204 - "POST /node/69fe575ae4d4e78cd76b2839 HTTP/1.0" 202 Accepted 2026-05-10 21:36:41,460 - lava_callback - INFO - Starting async job submit for node 69fe575ae4d4e78cd76b2839 2026-05-10 21:36:41,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:36:41,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe575ae4d4e78cd76b2839 HTTP/1.1" 200 None 2026-05-10 21:36:41,475 - lava_callback - DEBUG - Processing node 69fe575ae4d4e78cd76b2839: baseline-arm-clabbe 2026-05-10 21:36:41,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe575ae4d4e78cd76b2839 2026-05-10 21:36:41,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:36:41,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe575ae4d4e78cd76b2839 HTTP/1.1" 200 None 2026-05-10 21:36:41,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:36:41,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:36:41,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:36:41,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe575ae4d4e78cd76b2839 HTTP/1.1" 200 None 2026-05-10 21:36:41,521 - lava_callback - ERROR - Error processing callback for node 69fe575ae4d4e78cd76b2839: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:37:21,618 - lava_callback - INFO - Received callback for node 69fe577ee4d4e78cd76b284d INFO: 172.21.0.1:36780 - "POST /node/69fe577ee4d4e78cd76b284d HTTP/1.0" 202 Accepted 2026-05-10 21:37:21,623 - lava_callback - INFO - Starting async job submit for node 69fe577ee4d4e78cd76b284d 2026-05-10 21:37:21,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:37:21,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe577ee4d4e78cd76b284d HTTP/1.1" 200 None 2026-05-10 21:37:21,638 - lava_callback - DEBUG - Processing node 69fe577ee4d4e78cd76b284d: baseline-arm-clabbe 2026-05-10 21:37:21,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe577ee4d4e78cd76b284d 2026-05-10 21:37:21,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:37:21,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe577ee4d4e78cd76b284d HTTP/1.1" 200 None 2026-05-10 21:37:21,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:37:21,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:37:21,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:37:21,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe577ee4d4e78cd76b284d HTTP/1.1" 200 None 2026-05-10 21:37:21,697 - lava_callback - ERROR - Error processing callback for node 69fe577ee4d4e78cd76b284d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:38:01,490 - lava_callback - INFO - Received callback for node 69fe57a3e4d4e78cd76b286e INFO: 172.21.0.1:41012 - "POST /node/69fe57a3e4d4e78cd76b286e HTTP/1.0" 202 Accepted 2026-05-10 21:38:01,496 - lava_callback - INFO - Starting async job submit for node 69fe57a3e4d4e78cd76b286e 2026-05-10 21:38:01,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:38:01,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe57a3e4d4e78cd76b286e HTTP/1.1" 200 None 2026-05-10 21:38:01,513 - lava_callback - DEBUG - Processing node 69fe57a3e4d4e78cd76b286e: baseline-arm-clabbe 2026-05-10 21:38:01,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe57a3e4d4e78cd76b286e 2026-05-10 21:38:01,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:38:01,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe57a3e4d4e78cd76b286e HTTP/1.1" 200 None 2026-05-10 21:38:01,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:38:01,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:38:01,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:38:01,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe57a3e4d4e78cd76b286e HTTP/1.1" 200 None 2026-05-10 21:38:01,566 - lava_callback - ERROR - Error processing callback for node 69fe57a3e4d4e78cd76b286e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:38:21,540 - lava_callback - INFO - Received callback for node 69fe57c8e4d4e78cd76b287e INFO: 172.21.0.1:42200 - "POST /node/69fe57c8e4d4e78cd76b287e HTTP/1.0" 202 Accepted 2026-05-10 21:38:21,545 - lava_callback - INFO - Starting async job submit for node 69fe57c8e4d4e78cd76b287e 2026-05-10 21:38:21,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:38:21,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe57c8e4d4e78cd76b287e HTTP/1.1" 200 None 2026-05-10 21:38:21,560 - lava_callback - DEBUG - Processing node 69fe57c8e4d4e78cd76b287e: baseline-arm-clabbe 2026-05-10 21:38:21,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe57c8e4d4e78cd76b287e 2026-05-10 21:38:21,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:38:21,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe57c8e4d4e78cd76b287e HTTP/1.1" 200 None 2026-05-10 21:38:21,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:38:21,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:38:21,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:38:21,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe57c8e4d4e78cd76b287e HTTP/1.1" 200 None 2026-05-10 21:38:21,614 - lava_callback - ERROR - Error processing callback for node 69fe57c8e4d4e78cd76b287e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:39:01,549 - lava_callback - INFO - Received callback for node 69fe57ede4d4e78cd76b28a8 INFO: 172.21.0.1:57596 - "POST /node/69fe57ede4d4e78cd76b28a8 HTTP/1.0" 202 Accepted 2026-05-10 21:39:01,555 - lava_callback - INFO - Starting async job submit for node 69fe57ede4d4e78cd76b28a8 2026-05-10 21:39:01,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:39:01,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe57ede4d4e78cd76b28a8 HTTP/1.1" 200 None 2026-05-10 21:39:01,570 - lava_callback - DEBUG - Processing node 69fe57ede4d4e78cd76b28a8: baseline-arm-clabbe 2026-05-10 21:39:01,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe57ede4d4e78cd76b28a8 2026-05-10 21:39:01,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:39:01,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe57ede4d4e78cd76b28a8 HTTP/1.1" 200 None 2026-05-10 21:39:01,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:39:01,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:39:01,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:39:01,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe57ede4d4e78cd76b28a8 HTTP/1.1" 200 None 2026-05-10 21:39:01,614 - lava_callback - ERROR - Error processing callback for node 69fe57ede4d4e78cd76b28a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:39:41,607 - lava_callback - INFO - Received callback for node 69fe5814e4d4e78cd76b28be INFO: 172.21.0.1:51170 - "POST /node/69fe5814e4d4e78cd76b28be HTTP/1.0" 202 Accepted 2026-05-10 21:39:41,612 - lava_callback - INFO - Starting async job submit for node 69fe5814e4d4e78cd76b28be 2026-05-10 21:39:41,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:39:41,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5814e4d4e78cd76b28be HTTP/1.1" 200 None 2026-05-10 21:39:41,627 - lava_callback - DEBUG - Processing node 69fe5814e4d4e78cd76b28be: baseline-arm-clabbe 2026-05-10 21:39:41,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5814e4d4e78cd76b28be 2026-05-10 21:39:41,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:39:41,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5814e4d4e78cd76b28be HTTP/1.1" 200 None 2026-05-10 21:39:41,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:39:41,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:39:41,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:39:41,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5814e4d4e78cd76b28be HTTP/1.1" 200 None 2026-05-10 21:39:41,673 - lava_callback - ERROR - Error processing callback for node 69fe5814e4d4e78cd76b28be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:40:21,593 - lava_callback - INFO - Received callback for node 69fe5839e4d4e78cd76b28d5 INFO: 172.21.0.1:34542 - "POST /node/69fe5839e4d4e78cd76b28d5 HTTP/1.0" 202 Accepted 2026-05-10 21:40:21,599 - lava_callback - INFO - Starting async job submit for node 69fe5839e4d4e78cd76b28d5 2026-05-10 21:40:21,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:40:21,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5839e4d4e78cd76b28d5 HTTP/1.1" 200 None 2026-05-10 21:40:21,613 - lava_callback - DEBUG - Processing node 69fe5839e4d4e78cd76b28d5: baseline-arm-clabbe 2026-05-10 21:40:21,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5839e4d4e78cd76b28d5 2026-05-10 21:40:21,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:40:21,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5839e4d4e78cd76b28d5 HTTP/1.1" 200 None 2026-05-10 21:40:21,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:40:21,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-10 21:40:21,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:40:21,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5839e4d4e78cd76b28d5 HTTP/1.1" 200 None 2026-05-10 21:40:21,658 - lava_callback - ERROR - Error processing callback for node 69fe5839e4d4e78cd76b28d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:41:05,052 - lava_callback - INFO - Received callback for node 69fe5862e4d4e78cd76b28ed INFO: 172.21.0.1:41248 - "POST /node/69fe5862e4d4e78cd76b28ed HTTP/1.0" 202 Accepted 2026-05-10 21:41:05,058 - lava_callback - INFO - Starting async job submit for node 69fe5862e4d4e78cd76b28ed 2026-05-10 21:41:05,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:41:05,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5862e4d4e78cd76b28ed HTTP/1.1" 200 None 2026-05-10 21:41:05,073 - lava_callback - DEBUG - Processing node 69fe5862e4d4e78cd76b28ed: baseline-arm64-baylibre 2026-05-10 21:41:05,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5862e4d4e78cd76b28ed 2026-05-10 21:41:05,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:41:05,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5862e4d4e78cd76b28ed HTTP/1.1" 200 None 2026-05-10 21:41:05,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:41:05,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:41:05,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:41:05,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5862e4d4e78cd76b28ed HTTP/1.1" 200 None 2026-05-10 21:41:05,122 - lava_callback - ERROR - Error processing callback for node 69fe5862e4d4e78cd76b28ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:42:24,893 - lava_callback - INFO - Received callback for node 69fe58b4e4d4e78cd76b2917 INFO: 172.21.0.1:46302 - "POST /node/69fe58b4e4d4e78cd76b2917 HTTP/1.0" 202 Accepted 2026-05-10 21:42:24,899 - lava_callback - INFO - Starting async job submit for node 69fe58b4e4d4e78cd76b2917 2026-05-10 21:42:24,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:42:24,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe58b4e4d4e78cd76b2917 HTTP/1.1" 200 None 2026-05-10 21:42:24,915 - lava_callback - DEBUG - Processing node 69fe58b4e4d4e78cd76b2917: baseline-arm64-baylibre 2026-05-10 21:42:24,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe58b4e4d4e78cd76b2917 2026-05-10 21:42:24,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:42:24,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe58b4e4d4e78cd76b2917 HTTP/1.1" 200 None 2026-05-10 21:42:24,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:42:24,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:42:24,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:42:24,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe58b4e4d4e78cd76b2917 HTTP/1.1" 200 None 2026-05-10 21:42:24,961 - lava_callback - ERROR - Error processing callback for node 69fe58b4e4d4e78cd76b2917: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:43:44,960 - lava_callback - INFO - Received callback for node 69fe5906e4d4e78cd76b2946 INFO: 172.21.0.1:60234 - "POST /node/69fe5906e4d4e78cd76b2946 HTTP/1.0" 202 Accepted 2026-05-10 21:43:44,966 - lava_callback - INFO - Starting async job submit for node 69fe5906e4d4e78cd76b2946 2026-05-10 21:43:44,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:43:44,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5906e4d4e78cd76b2946 HTTP/1.1" 200 None 2026-05-10 21:43:44,980 - lava_callback - DEBUG - Processing node 69fe5906e4d4e78cd76b2946: baseline-arm64-baylibre 2026-05-10 21:43:44,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5906e4d4e78cd76b2946 2026-05-10 21:43:44,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:43:44,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5906e4d4e78cd76b2946 HTTP/1.1" 200 None 2026-05-10 21:43:44,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:43:45,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:43:45,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:43:45,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5906e4d4e78cd76b2946 HTTP/1.1" 200 None 2026-05-10 21:43:45,026 - lava_callback - ERROR - Error processing callback for node 69fe5906e4d4e78cd76b2946: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:45:05,077 - lava_callback - INFO - Received callback for node 69fe5959e4d4e78cd76b2970 INFO: 172.21.0.1:49438 - "POST /node/69fe5959e4d4e78cd76b2970 HTTP/1.0" 202 Accepted 2026-05-10 21:45:05,083 - lava_callback - INFO - Starting async job submit for node 69fe5959e4d4e78cd76b2970 2026-05-10 21:45:05,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:45:05,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5959e4d4e78cd76b2970 HTTP/1.1" 200 None 2026-05-10 21:45:05,099 - lava_callback - DEBUG - Processing node 69fe5959e4d4e78cd76b2970: baseline-arm64-baylibre 2026-05-10 21:45:05,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5959e4d4e78cd76b2970 2026-05-10 21:45:05,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:45:05,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5959e4d4e78cd76b2970 HTTP/1.1" 200 None 2026-05-10 21:45:05,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:45:05,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:45:05,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:45:05,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5959e4d4e78cd76b2970 HTTP/1.1" 200 None 2026-05-10 21:45:05,146 - lava_callback - ERROR - Error processing callback for node 69fe5959e4d4e78cd76b2970: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:47:45,257 - lava_callback - INFO - Received callback for node 69fe59fde4d4e78cd76b29b2 INFO: 172.21.0.1:39160 - "POST /node/69fe59fde4d4e78cd76b29b2 HTTP/1.0" 202 Accepted 2026-05-10 21:47:45,263 - lava_callback - INFO - Starting async job submit for node 69fe59fde4d4e78cd76b29b2 2026-05-10 21:47:45,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:47:45,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe59fde4d4e78cd76b29b2 HTTP/1.1" 200 None 2026-05-10 21:47:45,277 - lava_callback - DEBUG - Processing node 69fe59fde4d4e78cd76b29b2: baseline-arm64-baylibre 2026-05-10 21:47:45,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe59fde4d4e78cd76b29b2 2026-05-10 21:47:45,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:47:45,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe59fde4d4e78cd76b29b2 HTTP/1.1" 200 None 2026-05-10 21:47:45,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:47:45,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:47:45,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:47:45,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe59fde4d4e78cd76b29b2 HTTP/1.1" 200 None 2026-05-10 21:47:45,331 - lava_callback - ERROR - Error processing callback for node 69fe59fde4d4e78cd76b29b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:49:05,271 - lava_callback - INFO - Received callback for node 69fe5a4de4d4e78cd76b29d7 INFO: 172.21.0.1:56924 - "POST /node/69fe5a4de4d4e78cd76b29d7 HTTP/1.0" 202 Accepted 2026-05-10 21:49:05,277 - lava_callback - INFO - Starting async job submit for node 69fe5a4de4d4e78cd76b29d7 2026-05-10 21:49:05,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:49:05,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5a4de4d4e78cd76b29d7 HTTP/1.1" 200 None 2026-05-10 21:49:05,292 - lava_callback - DEBUG - Processing node 69fe5a4de4d4e78cd76b29d7: baseline-arm64-baylibre 2026-05-10 21:49:05,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5a4de4d4e78cd76b29d7 2026-05-10 21:49:05,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:49:05,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5a4de4d4e78cd76b29d7 HTTP/1.1" 200 None 2026-05-10 21:49:05,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:49:05,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:49:05,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:49:05,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5a4de4d4e78cd76b29d7 HTTP/1.1" 200 None 2026-05-10 21:49:05,348 - lava_callback - ERROR - Error processing callback for node 69fe5a4de4d4e78cd76b29d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:50:42,070 - lava_callback - INFO - Received callback for node 69fe5aaae4d4e78cd76b29fe INFO: 172.21.0.1:40796 - "POST /node/69fe5aaae4d4e78cd76b29fe HTTP/1.0" 202 Accepted 2026-05-10 21:50:42,075 - lava_callback - INFO - Starting async job submit for node 69fe5aaae4d4e78cd76b29fe 2026-05-10 21:50:42,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:50:42,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5aaae4d4e78cd76b29fe HTTP/1.1" 200 None 2026-05-10 21:50:42,091 - lava_callback - DEBUG - Processing node 69fe5aaae4d4e78cd76b29fe: baseline-arm64-clabbe 2026-05-10 21:50:42,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5aaae4d4e78cd76b29fe 2026-05-10 21:50:42,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:50:42,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5aaae4d4e78cd76b29fe HTTP/1.1" 200 None 2026-05-10 21:50:42,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:50:42,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:50:42,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:50:42,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5aaae4d4e78cd76b29fe HTTP/1.1" 200 None 2026-05-10 21:50:42,154 - lava_callback - ERROR - Error processing callback for node 69fe5aaae4d4e78cd76b29fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:53:25,544 - lava_callback - INFO - Received callback for node 69fe5b49e4d4e78cd76b2a40 INFO: 172.21.0.1:49822 - "POST /node/69fe5b49e4d4e78cd76b2a40 HTTP/1.0" 202 Accepted 2026-05-10 21:53:25,550 - lava_callback - INFO - Starting async job submit for node 69fe5b49e4d4e78cd76b2a40 2026-05-10 21:53:25,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:53:25,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5b49e4d4e78cd76b2a40 HTTP/1.1" 200 None 2026-05-10 21:53:25,580 - lava_callback - DEBUG - Processing node 69fe5b49e4d4e78cd76b2a40: baseline-arm64-baylibre 2026-05-10 21:53:25,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5b49e4d4e78cd76b2a40 2026-05-10 21:53:25,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:53:25,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5b49e4d4e78cd76b2a40 HTTP/1.1" 200 None 2026-05-10 21:53:25,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:53:25,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:53:25,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:53:25,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5b49e4d4e78cd76b2a40 HTTP/1.1" 200 None 2026-05-10 21:53:25,634 - lava_callback - ERROR - Error processing callback for node 69fe5b49e4d4e78cd76b2a40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:55:02,402 - lava_callback - INFO - Received callback for node 69fe5ba4e4d4e78cd76b2a63 INFO: 172.21.0.1:35488 - "POST /node/69fe5ba4e4d4e78cd76b2a63 HTTP/1.0" 202 Accepted 2026-05-10 21:55:02,408 - lava_callback - INFO - Starting async job submit for node 69fe5ba4e4d4e78cd76b2a63 2026-05-10 21:55:02,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:55:02,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5ba4e4d4e78cd76b2a63 HTTP/1.1" 200 None 2026-05-10 21:55:02,427 - lava_callback - DEBUG - Processing node 69fe5ba4e4d4e78cd76b2a63: baseline-arm64-clabbe 2026-05-10 21:55:02,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5ba4e4d4e78cd76b2a63 2026-05-10 21:55:02,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:55:02,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5ba4e4d4e78cd76b2a63 HTTP/1.1" 200 None 2026-05-10 21:55:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:55:02,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:55:02,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:55:02,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5ba4e4d4e78cd76b2a63 HTTP/1.1" 200 None 2026-05-10 21:55:02,482 - lava_callback - ERROR - Error processing callback for node 69fe5ba4e4d4e78cd76b2a63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:56:05,684 - lava_callback - INFO - Received callback for node 69fe5beee4d4e78cd76b2a92 INFO: 172.21.0.1:46256 - "POST /node/69fe5beee4d4e78cd76b2a92 HTTP/1.0" 202 Accepted 2026-05-10 21:56:05,693 - lava_callback - INFO - Starting async job submit for node 69fe5beee4d4e78cd76b2a92 2026-05-10 21:56:05,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:56:05,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5beee4d4e78cd76b2a92 HTTP/1.1" 200 None 2026-05-10 21:56:05,715 - lava_callback - DEBUG - Processing node 69fe5beee4d4e78cd76b2a92: baseline-arm64-baylibre 2026-05-10 21:56:05,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5beee4d4e78cd76b2a92 2026-05-10 21:56:05,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:56:05,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5beee4d4e78cd76b2a92 HTTP/1.1" 200 None 2026-05-10 21:56:05,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:56:05,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:56:05,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:56:05,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5beee4d4e78cd76b2a92 HTTP/1.1" 200 None 2026-05-10 21:56:05,780 - lava_callback - ERROR - Error processing callback for node 69fe5beee4d4e78cd76b2a92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40566 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:57:42,267 - lava_callback - INFO - Received callback for node 69fe5c46e4d4e78cd76b2ac0 INFO: 172.21.0.1:40568 - "POST /node/69fe5c46e4d4e78cd76b2ac0 HTTP/1.0" 202 Accepted 2026-05-10 21:57:42,273 - lava_callback - INFO - Starting async job submit for node 69fe5c46e4d4e78cd76b2ac0 2026-05-10 21:57:42,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:57:42,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5c46e4d4e78cd76b2ac0 HTTP/1.1" 200 None 2026-05-10 21:57:42,291 - lava_callback - DEBUG - Processing node 69fe5c46e4d4e78cd76b2ac0: baseline-arm64-clabbe 2026-05-10 21:57:42,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5c46e4d4e78cd76b2ac0 2026-05-10 21:57:42,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:57:42,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5c46e4d4e78cd76b2ac0 HTTP/1.1" 200 None 2026-05-10 21:57:42,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:57:42,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:57:42,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:57:42,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5c46e4d4e78cd76b2ac0 HTTP/1.1" 200 None 2026-05-10 21:57:42,351 - lava_callback - ERROR - Error processing callback for node 69fe5c46e4d4e78cd76b2ac0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET / HTTP/1.0" 200 OK 2026-05-10 21:59:02,299 - lava_callback - INFO - Received callback for node 69fe5c98e4d4e78cd76b2ade INFO: 172.21.0.1:35186 - "POST /node/69fe5c98e4d4e78cd76b2ade HTTP/1.0" 202 Accepted 2026-05-10 21:59:02,306 - lava_callback - INFO - Starting async job submit for node 69fe5c98e4d4e78cd76b2ade 2026-05-10 21:59:02,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:59:02,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5c98e4d4e78cd76b2ade HTTP/1.1" 200 None 2026-05-10 21:59:02,325 - lava_callback - DEBUG - Processing node 69fe5c98e4d4e78cd76b2ade: baseline-arm64-clabbe 2026-05-10 21:59:02,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5c98e4d4e78cd76b2ade 2026-05-10 21:59:02,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:59:02,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5c98e4d4e78cd76b2ade HTTP/1.1" 200 None 2026-05-10 21:59:02,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:59:02,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 21:59:02,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 21:59:02,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5c98e4d4e78cd76b2ade HTTP/1.1" 200 None 2026-05-10 21:59:02,386 - lava_callback - ERROR - Error processing callback for node 69fe5c98e4d4e78cd76b2ade: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:00:22,344 - lava_callback - INFO - Received callback for node 69fe5cebe4d4e78cd76b2b05 INFO: 172.21.0.1:55136 - "POST /node/69fe5cebe4d4e78cd76b2b05 HTTP/1.0" 202 Accepted 2026-05-10 22:00:22,350 - lava_callback - INFO - Starting async job submit for node 69fe5cebe4d4e78cd76b2b05 2026-05-10 22:00:22,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:00:22,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5cebe4d4e78cd76b2b05 HTTP/1.1" 200 None 2026-05-10 22:00:22,364 - lava_callback - DEBUG - Processing node 69fe5cebe4d4e78cd76b2b05: baseline-arm64-clabbe 2026-05-10 22:00:22,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5cebe4d4e78cd76b2b05 2026-05-10 22:00:22,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:00:22,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5cebe4d4e78cd76b2b05 HTTP/1.1" 200 None 2026-05-10 22:00:22,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:00:22,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:00:22,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:00:22,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5cebe4d4e78cd76b2b05 HTTP/1.1" 200 None 2026-05-10 22:00:22,421 - lava_callback - ERROR - Error processing callback for node 69fe5cebe4d4e78cd76b2b05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:01:42,419 - lava_callback - INFO - Received callback for node 69fe5d3ee4d4e78cd76b2b2b INFO: 172.21.0.1:39792 - "POST /node/69fe5d3ee4d4e78cd76b2b2b HTTP/1.0" 202 Accepted 2026-05-10 22:01:42,424 - lava_callback - INFO - Starting async job submit for node 69fe5d3ee4d4e78cd76b2b2b 2026-05-10 22:01:42,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:01:42,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5d3ee4d4e78cd76b2b2b HTTP/1.1" 200 None 2026-05-10 22:01:42,443 - lava_callback - DEBUG - Processing node 69fe5d3ee4d4e78cd76b2b2b: baseline-arm64-clabbe 2026-05-10 22:01:42,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5d3ee4d4e78cd76b2b2b 2026-05-10 22:01:42,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:01:42,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5d3ee4d4e78cd76b2b2b HTTP/1.1" 200 None 2026-05-10 22:01:42,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:01:42,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:01:42,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:01:42,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5d3ee4d4e78cd76b2b2b HTTP/1.1" 200 None 2026-05-10 22:01:42,487 - lava_callback - ERROR - Error processing callback for node 69fe5d3ee4d4e78cd76b2b2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:03:02,476 - lava_callback - INFO - Received callback for node 69fe5d92e4d4e78cd76b2b52 INFO: 172.21.0.1:53652 - "POST /node/69fe5d92e4d4e78cd76b2b52 HTTP/1.0" 202 Accepted 2026-05-10 22:03:02,481 - lava_callback - INFO - Starting async job submit for node 69fe5d92e4d4e78cd76b2b52 2026-05-10 22:03:02,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:03:02,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5d92e4d4e78cd76b2b52 HTTP/1.1" 200 None 2026-05-10 22:03:02,496 - lava_callback - DEBUG - Processing node 69fe5d92e4d4e78cd76b2b52: baseline-arm64-clabbe 2026-05-10 22:03:02,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5d92e4d4e78cd76b2b52 2026-05-10 22:03:02,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:03:02,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5d92e4d4e78cd76b2b52 HTTP/1.1" 200 None 2026-05-10 22:03:02,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:03:02,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:03:02,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:03:02,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5d92e4d4e78cd76b2b52 HTTP/1.1" 200 None 2026-05-10 22:03:02,541 - lava_callback - ERROR - Error processing callback for node 69fe5d92e4d4e78cd76b2b52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:04:42,548 - lava_callback - INFO - Received callback for node 69fe5de8e4d4e78cd76b2b7d INFO: 172.21.0.1:45580 - "POST /node/69fe5de8e4d4e78cd76b2b7d HTTP/1.0" 202 Accepted 2026-05-10 22:04:42,556 - lava_callback - INFO - Starting async job submit for node 69fe5de8e4d4e78cd76b2b7d 2026-05-10 22:04:42,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:04:42,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5de8e4d4e78cd76b2b7d HTTP/1.1" 200 None 2026-05-10 22:04:42,571 - lava_callback - DEBUG - Processing node 69fe5de8e4d4e78cd76b2b7d: baseline-arm64-clabbe 2026-05-10 22:04:42,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5de8e4d4e78cd76b2b7d 2026-05-10 22:04:42,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:04:42,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5de8e4d4e78cd76b2b7d HTTP/1.1" 200 None 2026-05-10 22:04:42,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:04:42,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:04:42,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:04:42,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5de8e4d4e78cd76b2b7d HTTP/1.1" 200 None 2026-05-10 22:04:42,625 - lava_callback - ERROR - Error processing callback for node 69fe5de8e4d4e78cd76b2b7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:06:02,749 - lava_callback - INFO - Received callback for node 69fe5e3ce4d4e78cd76b2b94 INFO: 172.21.0.1:36654 - "POST /node/69fe5e3ce4d4e78cd76b2b94 HTTP/1.0" 202 Accepted 2026-05-10 22:06:02,755 - lava_callback - INFO - Starting async job submit for node 69fe5e3ce4d4e78cd76b2b94 2026-05-10 22:06:02,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:06:02,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5e3ce4d4e78cd76b2b94 HTTP/1.1" 200 None 2026-05-10 22:06:02,773 - lava_callback - DEBUG - Processing node 69fe5e3ce4d4e78cd76b2b94: baseline-arm64-clabbe 2026-05-10 22:06:02,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5e3ce4d4e78cd76b2b94 2026-05-10 22:06:02,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:06:02,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5e3ce4d4e78cd76b2b94 HTTP/1.1" 200 None 2026-05-10 22:06:02,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:06:02,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:06:02,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:06:02,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5e3ce4d4e78cd76b2b94 HTTP/1.1" 200 None 2026-05-10 22:06:02,841 - lava_callback - ERROR - Error processing callback for node 69fe5e3ce4d4e78cd76b2b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:07:22,667 - lava_callback - INFO - Received callback for node 69fe5e8fe4d4e78cd76b2bbc INFO: 172.21.0.1:44312 - "POST /node/69fe5e8fe4d4e78cd76b2bbc HTTP/1.0" 202 Accepted 2026-05-10 22:07:22,674 - lava_callback - INFO - Starting async job submit for node 69fe5e8fe4d4e78cd76b2bbc 2026-05-10 22:07:22,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:07:22,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5e8fe4d4e78cd76b2bbc HTTP/1.1" 200 None 2026-05-10 22:07:22,689 - lava_callback - DEBUG - Processing node 69fe5e8fe4d4e78cd76b2bbc: baseline-arm64-clabbe 2026-05-10 22:07:22,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5e8fe4d4e78cd76b2bbc 2026-05-10 22:07:22,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:07:22,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5e8fe4d4e78cd76b2bbc HTTP/1.1" 200 None 2026-05-10 22:07:22,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:07:22,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:07:22,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:07:22,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5e8fe4d4e78cd76b2bbc HTTP/1.1" 200 None 2026-05-10 22:07:22,736 - lava_callback - ERROR - Error processing callback for node 69fe5e8fe4d4e78cd76b2bbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:08:42,746 - lava_callback - INFO - Received callback for node 69fe5ee1e4d4e78cd76b2be3 INFO: 172.21.0.1:45408 - "POST /node/69fe5ee1e4d4e78cd76b2be3 HTTP/1.0" 202 Accepted 2026-05-10 22:08:42,752 - lava_callback - INFO - Starting async job submit for node 69fe5ee1e4d4e78cd76b2be3 2026-05-10 22:08:42,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:08:42,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5ee1e4d4e78cd76b2be3 HTTP/1.1" 200 None 2026-05-10 22:08:42,768 - lava_callback - DEBUG - Processing node 69fe5ee1e4d4e78cd76b2be3: baseline-arm64-clabbe 2026-05-10 22:08:42,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5ee1e4d4e78cd76b2be3 2026-05-10 22:08:42,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:08:42,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5ee1e4d4e78cd76b2be3 HTTP/1.1" 200 None 2026-05-10 22:08:42,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:08:42,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:08:42,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:08:42,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5ee1e4d4e78cd76b2be3 HTTP/1.1" 200 None 2026-05-10 22:08:42,823 - lava_callback - ERROR - Error processing callback for node 69fe5ee1e4d4e78cd76b2be3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:11:22,846 - lava_callback - INFO - Received callback for node 69fe5f86e4d4e78cd76b2c2c INFO: 172.21.0.1:47354 - "POST /node/69fe5f86e4d4e78cd76b2c2c HTTP/1.0" 202 Accepted 2026-05-10 22:11:22,851 - lava_callback - INFO - Starting async job submit for node 69fe5f86e4d4e78cd76b2c2c 2026-05-10 22:11:22,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:11:22,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5f86e4d4e78cd76b2c2c HTTP/1.1" 200 None 2026-05-10 22:11:22,867 - lava_callback - DEBUG - Processing node 69fe5f86e4d4e78cd76b2c2c: baseline-arm64-clabbe 2026-05-10 22:11:22,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5f86e4d4e78cd76b2c2c 2026-05-10 22:11:22,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:11:22,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5f86e4d4e78cd76b2c2c HTTP/1.1" 200 None 2026-05-10 22:11:22,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:11:22,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:11:22,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:11:22,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5f86e4d4e78cd76b2c2c HTTP/1.1" 200 None 2026-05-10 22:11:22,912 - lava_callback - ERROR - Error processing callback for node 69fe5f86e4d4e78cd76b2c2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56386 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:12:46,651 - lava_callback - INFO - Received callback for node 69fe5fcee4d4e78cd76b2c51 INFO: 172.21.0.1:56398 - "POST /node/69fe5fcee4d4e78cd76b2c51 HTTP/1.0" 202 Accepted 2026-05-10 22:12:46,656 - lava_callback - INFO - Starting async job submit for node 69fe5fcee4d4e78cd76b2c51 2026-05-10 22:12:46,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:12:46,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5fcee4d4e78cd76b2c51 HTTP/1.1" 200 None 2026-05-10 22:12:46,671 - lava_callback - DEBUG - Processing node 69fe5fcee4d4e78cd76b2c51: baseline-arm64-baylibre 2026-05-10 22:12:46,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe5fcee4d4e78cd76b2c51 2026-05-10 22:12:46,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:12:46,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5fcee4d4e78cd76b2c51 HTTP/1.1" 200 None 2026-05-10 22:12:46,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:12:46,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:12:46,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:12:46,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5fcee4d4e78cd76b2c51 HTTP/1.1" 200 None 2026-05-10 22:12:46,725 - lava_callback - ERROR - Error processing callback for node 69fe5fcee4d4e78cd76b2c51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:16:46,796 - lava_callback - INFO - Received callback for node 69fe60c2e4d4e78cd76b2cb4 INFO: 172.21.0.1:55644 - "POST /node/69fe60c2e4d4e78cd76b2cb4 HTTP/1.0" 202 Accepted 2026-05-10 22:16:46,802 - lava_callback - INFO - Starting async job submit for node 69fe60c2e4d4e78cd76b2cb4 2026-05-10 22:16:46,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:16:46,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe60c2e4d4e78cd76b2cb4 HTTP/1.1" 200 None 2026-05-10 22:16:46,817 - lava_callback - DEBUG - Processing node 69fe60c2e4d4e78cd76b2cb4: baseline-arm64-baylibre 2026-05-10 22:16:46,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe60c2e4d4e78cd76b2cb4 2026-05-10 22:16:46,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:16:46,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe60c2e4d4e78cd76b2cb4 HTTP/1.1" 200 None 2026-05-10 22:16:46,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:16:46,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:16:46,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:16:46,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe60c2e4d4e78cd76b2cb4 HTTP/1.1" 200 None 2026-05-10 22:16:46,881 - lava_callback - ERROR - Error processing callback for node 69fe60c2e4d4e78cd76b2cb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:18:03,089 - lava_callback - INFO - Received callback for node 69fe6118e4d4e78cd76b2cd8 INFO: 172.21.0.1:46886 - "POST /node/69fe6118e4d4e78cd76b2cd8 HTTP/1.0" 202 Accepted 2026-05-10 22:18:03,095 - lava_callback - INFO - Starting async job submit for node 69fe6118e4d4e78cd76b2cd8 2026-05-10 22:18:03,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:18:03,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6118e4d4e78cd76b2cd8 HTTP/1.1" 200 None 2026-05-10 22:18:03,112 - lava_callback - DEBUG - Processing node 69fe6118e4d4e78cd76b2cd8: baseline-arm64-clabbe 2026-05-10 22:18:03,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6118e4d4e78cd76b2cd8 2026-05-10 22:18:03,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:18:03,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6118e4d4e78cd76b2cd8 HTTP/1.1" 200 None 2026-05-10 22:18:03,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:18:03,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:18:03,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:18:03,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6118e4d4e78cd76b2cd8 HTTP/1.1" 200 None 2026-05-10 22:18:03,179 - lava_callback - ERROR - Error processing callback for node 69fe6118e4d4e78cd76b2cd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:19:43,191 - lava_callback - INFO - Received callback for node 69fe6169e4d4e78cd76b2d05 INFO: 172.21.0.1:53220 - "POST /node/69fe6169e4d4e78cd76b2d05 HTTP/1.0" 202 Accepted 2026-05-10 22:19:43,196 - lava_callback - INFO - Starting async job submit for node 69fe6169e4d4e78cd76b2d05 2026-05-10 22:19:43,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:19:43,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6169e4d4e78cd76b2d05 HTTP/1.1" 200 None 2026-05-10 22:19:43,212 - lava_callback - DEBUG - Processing node 69fe6169e4d4e78cd76b2d05: baseline-arm64-clabbe 2026-05-10 22:19:43,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6169e4d4e78cd76b2d05 2026-05-10 22:19:43,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:19:43,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6169e4d4e78cd76b2d05 HTTP/1.1" 200 None 2026-05-10 22:19:43,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:19:43,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:19:43,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:19:43,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6169e4d4e78cd76b2d05 HTTP/1.1" 200 None 2026-05-10 22:19:43,258 - lava_callback - ERROR - Error processing callback for node 69fe6169e4d4e78cd76b2d05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:21:03,284 - lava_callback - INFO - Received callback for node 69fe61bbe4d4e78cd76b2d1d INFO: 172.21.0.1:38074 - "POST /node/69fe61bbe4d4e78cd76b2d1d HTTP/1.0" 202 Accepted 2026-05-10 22:21:03,289 - lava_callback - INFO - Starting async job submit for node 69fe61bbe4d4e78cd76b2d1d 2026-05-10 22:21:03,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:21:03,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe61bbe4d4e78cd76b2d1d HTTP/1.1" 200 None 2026-05-10 22:21:03,304 - lava_callback - DEBUG - Processing node 69fe61bbe4d4e78cd76b2d1d: baseline-arm64-clabbe 2026-05-10 22:21:03,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe61bbe4d4e78cd76b2d1d 2026-05-10 22:21:03,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:21:03,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe61bbe4d4e78cd76b2d1d HTTP/1.1" 200 None 2026-05-10 22:21:03,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:21:03,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:21:03,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:21:03,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe61bbe4d4e78cd76b2d1d HTTP/1.1" 200 None 2026-05-10 22:21:03,353 - lava_callback - ERROR - Error processing callback for node 69fe61bbe4d4e78cd76b2d1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:22:23,369 - lava_callback - INFO - Received callback for node 69fe620ce4d4e78cd76b2d4c INFO: 172.21.0.1:39052 - "POST /node/69fe620ce4d4e78cd76b2d4c HTTP/1.0" 202 Accepted 2026-05-10 22:22:23,375 - lava_callback - INFO - Starting async job submit for node 69fe620ce4d4e78cd76b2d4c 2026-05-10 22:22:23,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:22:23,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe620ce4d4e78cd76b2d4c HTTP/1.1" 200 None 2026-05-10 22:22:23,432 - lava_callback - DEBUG - Processing node 69fe620ce4d4e78cd76b2d4c: baseline-arm64-clabbe 2026-05-10 22:22:23,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe620ce4d4e78cd76b2d4c 2026-05-10 22:22:23,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:22:23,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe620ce4d4e78cd76b2d4c HTTP/1.1" 200 None 2026-05-10 22:22:23,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:22:23,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:22:23,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:22:23,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe620ce4d4e78cd76b2d4c HTTP/1.1" 200 None 2026-05-10 22:22:23,555 - lava_callback - ERROR - Error processing callback for node 69fe620ce4d4e78cd76b2d4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:23:43,345 - lava_callback - INFO - Received callback for node 69fe625de4d4e78cd76b2d78 INFO: 172.21.0.1:43304 - "POST /node/69fe625de4d4e78cd76b2d78 HTTP/1.0" 202 Accepted 2026-05-10 22:23:43,351 - lava_callback - INFO - Starting async job submit for node 69fe625de4d4e78cd76b2d78 2026-05-10 22:23:43,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:23:43,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe625de4d4e78cd76b2d78 HTTP/1.1" 200 None 2026-05-10 22:23:43,365 - lava_callback - DEBUG - Processing node 69fe625de4d4e78cd76b2d78: baseline-arm64-clabbe 2026-05-10 22:23:43,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe625de4d4e78cd76b2d78 2026-05-10 22:23:43,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:23:43,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe625de4d4e78cd76b2d78 HTTP/1.1" 200 None 2026-05-10 22:23:43,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:23:43,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:23:43,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:23:43,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe625de4d4e78cd76b2d78 HTTP/1.1" 200 None 2026-05-10 22:23:43,410 - lava_callback - ERROR - Error processing callback for node 69fe625de4d4e78cd76b2d78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:25:03,429 - lava_callback - INFO - Received callback for node 69fe62b0e4d4e78cd76b2d8f INFO: 172.21.0.1:33164 - "POST /node/69fe62b0e4d4e78cd76b2d8f HTTP/1.0" 202 Accepted 2026-05-10 22:25:03,435 - lava_callback - INFO - Starting async job submit for node 69fe62b0e4d4e78cd76b2d8f 2026-05-10 22:25:03,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:25:03,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe62b0e4d4e78cd76b2d8f HTTP/1.1" 200 None 2026-05-10 22:25:03,450 - lava_callback - DEBUG - Processing node 69fe62b0e4d4e78cd76b2d8f: baseline-arm64-clabbe 2026-05-10 22:25:03,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe62b0e4d4e78cd76b2d8f 2026-05-10 22:25:03,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:25:03,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe62b0e4d4e78cd76b2d8f HTTP/1.1" 200 None 2026-05-10 22:25:03,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:25:03,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-10 22:25:03,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:25:03,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe62b0e4d4e78cd76b2d8f HTTP/1.1" 200 None 2026-05-10 22:25:03,510 - lava_callback - ERROR - Error processing callback for node 69fe62b0e4d4e78cd76b2d8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET /node/6992e89c31166481c8dd86cb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:38:48,136 - lava_callback - INFO - Received callback for node 69fe65e4e4d4e78cd76b2e27 INFO: 172.21.0.1:41342 - "POST /node/69fe65e4e4d4e78cd76b2e27 HTTP/1.0" 202 Accepted 2026-05-10 22:38:48,141 - lava_callback - INFO - Starting async job submit for node 69fe65e4e4d4e78cd76b2e27 2026-05-10 22:38:48,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:38:48,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe65e4e4d4e78cd76b2e27 HTTP/1.1" 200 None 2026-05-10 22:38:48,158 - lava_callback - DEBUG - Processing node 69fe65e4e4d4e78cd76b2e27: baseline-arm-baylibre 2026-05-10 22:38:48,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe65e4e4d4e78cd76b2e27 2026-05-10 22:38:48,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:38:48,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe65e4e4d4e78cd76b2e27 HTTP/1.1" 200 None 2026-05-10 22:38:48,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:38:48,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:38:48,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:38:48,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe65e4e4d4e78cd76b2e27 HTTP/1.1" 200 None 2026-05-10 22:38:48,211 - lava_callback - ERROR - Error processing callback for node 69fe65e4e4d4e78cd76b2e27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:39:08,001 - lava_callback - INFO - Received callback for node 69fe660ae4d4e78cd76b2e3e INFO: 172.21.0.1:39100 - "POST /node/69fe660ae4d4e78cd76b2e3e HTTP/1.0" 202 Accepted 2026-05-10 22:39:08,007 - lava_callback - INFO - Starting async job submit for node 69fe660ae4d4e78cd76b2e3e 2026-05-10 22:39:08,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:39:08,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe660ae4d4e78cd76b2e3e HTTP/1.1" 200 None 2026-05-10 22:39:08,023 - lava_callback - DEBUG - Processing node 69fe660ae4d4e78cd76b2e3e: baseline-arm-baylibre 2026-05-10 22:39:08,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe660ae4d4e78cd76b2e3e 2026-05-10 22:39:08,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:39:08,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe660ae4d4e78cd76b2e3e HTTP/1.1" 200 None 2026-05-10 22:39:08,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:39:08,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:39:08,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:39:08,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe660ae4d4e78cd76b2e3e HTTP/1.1" 200 None 2026-05-10 22:39:08,069 - lava_callback - ERROR - Error processing callback for node 69fe660ae4d4e78cd76b2e3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:39:48,044 - lava_callback - INFO - Received callback for node 69fe6630e4d4e78cd76b2e52 INFO: 172.21.0.1:43092 - "POST /node/69fe6630e4d4e78cd76b2e52 HTTP/1.0" 202 Accepted 2026-05-10 22:39:48,049 - lava_callback - INFO - Starting async job submit for node 69fe6630e4d4e78cd76b2e52 2026-05-10 22:39:48,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:39:48,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6630e4d4e78cd76b2e52 HTTP/1.1" 200 None 2026-05-10 22:39:48,065 - lava_callback - DEBUG - Processing node 69fe6630e4d4e78cd76b2e52: baseline-arm-baylibre 2026-05-10 22:39:48,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6630e4d4e78cd76b2e52 2026-05-10 22:39:48,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:39:48,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6630e4d4e78cd76b2e52 HTTP/1.1" 200 None 2026-05-10 22:39:48,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:39:48,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:39:48,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:39:48,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6630e4d4e78cd76b2e52 HTTP/1.1" 200 None 2026-05-10 22:39:48,126 - lava_callback - ERROR - Error processing callback for node 69fe6630e4d4e78cd76b2e52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:40:28,157 - lava_callback - INFO - Received callback for node 69fe6657e4d4e78cd76b2e6e INFO: 172.21.0.1:44662 - "POST /node/69fe6657e4d4e78cd76b2e6e HTTP/1.0" 202 Accepted 2026-05-10 22:40:28,162 - lava_callback - INFO - Starting async job submit for node 69fe6657e4d4e78cd76b2e6e 2026-05-10 22:40:28,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:40:28,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6657e4d4e78cd76b2e6e HTTP/1.1" 200 None 2026-05-10 22:40:28,178 - lava_callback - DEBUG - Processing node 69fe6657e4d4e78cd76b2e6e: baseline-arm-baylibre 2026-05-10 22:40:28,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6657e4d4e78cd76b2e6e 2026-05-10 22:40:28,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:40:28,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6657e4d4e78cd76b2e6e HTTP/1.1" 200 None 2026-05-10 22:40:28,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:40:28,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:40:28,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:40:28,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6657e4d4e78cd76b2e6e HTTP/1.1" 200 None 2026-05-10 22:40:28,223 - lava_callback - ERROR - Error processing callback for node 69fe6657e4d4e78cd76b2e6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:41:08,111 - lava_callback - INFO - Received callback for node 69fe667ee4d4e78cd76b2e81 INFO: 172.21.0.1:38480 - "POST /node/69fe667ee4d4e78cd76b2e81 HTTP/1.0" 202 Accepted 2026-05-10 22:41:08,117 - lava_callback - INFO - Starting async job submit for node 69fe667ee4d4e78cd76b2e81 2026-05-10 22:41:08,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:41:08,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe667ee4d4e78cd76b2e81 HTTP/1.1" 200 None 2026-05-10 22:41:08,131 - lava_callback - DEBUG - Processing node 69fe667ee4d4e78cd76b2e81: baseline-arm-baylibre 2026-05-10 22:41:08,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe667ee4d4e78cd76b2e81 2026-05-10 22:41:08,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:41:08,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe667ee4d4e78cd76b2e81 HTTP/1.1" 200 None 2026-05-10 22:41:08,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:41:08,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:41:08,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:41:08,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe667ee4d4e78cd76b2e81 HTTP/1.1" 200 None 2026-05-10 22:41:08,176 - lava_callback - ERROR - Error processing callback for node 69fe667ee4d4e78cd76b2e81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:41:48,206 - lava_callback - INFO - Received callback for node 69fe66a4e4d4e78cd76b2e97 INFO: 172.21.0.1:35684 - "POST /node/69fe66a4e4d4e78cd76b2e97 HTTP/1.0" 202 Accepted 2026-05-10 22:41:48,212 - lava_callback - INFO - Starting async job submit for node 69fe66a4e4d4e78cd76b2e97 2026-05-10 22:41:48,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:41:48,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe66a4e4d4e78cd76b2e97 HTTP/1.1" 200 None 2026-05-10 22:41:48,227 - lava_callback - DEBUG - Processing node 69fe66a4e4d4e78cd76b2e97: baseline-arm-baylibre 2026-05-10 22:41:48,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe66a4e4d4e78cd76b2e97 2026-05-10 22:41:48,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:41:48,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe66a4e4d4e78cd76b2e97 HTTP/1.1" 200 None 2026-05-10 22:41:48,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:41:48,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:41:48,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:41:48,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe66a4e4d4e78cd76b2e97 HTTP/1.1" 200 None 2026-05-10 22:41:48,278 - lava_callback - ERROR - Error processing callback for node 69fe66a4e4d4e78cd76b2e97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:43:44,146 - lava_callback - INFO - Received callback for node 69fe6716e4d4e78cd76b2ed8 INFO: 172.21.0.1:49550 - "POST /node/69fe6716e4d4e78cd76b2ed8 HTTP/1.0" 202 Accepted 2026-05-10 22:43:44,152 - lava_callback - INFO - Starting async job submit for node 69fe6716e4d4e78cd76b2ed8 2026-05-10 22:43:44,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:43:44,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6716e4d4e78cd76b2ed8 HTTP/1.1" 200 None 2026-05-10 22:43:44,169 - lava_callback - DEBUG - Processing node 69fe6716e4d4e78cd76b2ed8: baseline-arm-clabbe 2026-05-10 22:43:44,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6716e4d4e78cd76b2ed8 2026-05-10 22:43:44,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:43:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6716e4d4e78cd76b2ed8 HTTP/1.1" 200 None 2026-05-10 22:43:44,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:43:44,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:43:44,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:43:44,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6716e4d4e78cd76b2ed8 HTTP/1.1" 200 None 2026-05-10 22:43:44,240 - lava_callback - ERROR - Error processing callback for node 69fe6716e4d4e78cd76b2ed8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:44:24,168 - lava_callback - INFO - Received callback for node 69fe673ce4d4e78cd76b2eee INFO: 172.21.0.1:45500 - "POST /node/69fe673ce4d4e78cd76b2eee HTTP/1.0" 202 Accepted 2026-05-10 22:44:24,175 - lava_callback - INFO - Starting async job submit for node 69fe673ce4d4e78cd76b2eee 2026-05-10 22:44:24,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:44:24,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe673ce4d4e78cd76b2eee HTTP/1.1" 200 None 2026-05-10 22:44:24,203 - lava_callback - DEBUG - Processing node 69fe673ce4d4e78cd76b2eee: baseline-arm-clabbe 2026-05-10 22:44:24,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe673ce4d4e78cd76b2eee 2026-05-10 22:44:24,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:44:24,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe673ce4d4e78cd76b2eee HTTP/1.1" 200 None 2026-05-10 22:44:24,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:44:24,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:44:24,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:44:24,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe673ce4d4e78cd76b2eee HTTP/1.1" 200 None 2026-05-10 22:44:24,249 - lava_callback - ERROR - Error processing callback for node 69fe673ce4d4e78cd76b2eee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:45:04,371 - lava_callback - INFO - Received callback for node 69fe6762e4d4e78cd76b2f06 INFO: 172.21.0.1:57460 - "POST /node/69fe6762e4d4e78cd76b2f06 HTTP/1.0" 202 Accepted 2026-05-10 22:45:04,377 - lava_callback - INFO - Starting async job submit for node 69fe6762e4d4e78cd76b2f06 2026-05-10 22:45:04,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:45:04,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6762e4d4e78cd76b2f06 HTTP/1.1" 200 None 2026-05-10 22:45:04,392 - lava_callback - DEBUG - Processing node 69fe6762e4d4e78cd76b2f06: baseline-arm-clabbe 2026-05-10 22:45:04,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6762e4d4e78cd76b2f06 2026-05-10 22:45:04,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:45:04,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6762e4d4e78cd76b2f06 HTTP/1.1" 200 None 2026-05-10 22:45:04,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:45:04,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:45:04,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:45:04,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6762e4d4e78cd76b2f06 HTTP/1.1" 200 None 2026-05-10 22:45:04,438 - lava_callback - ERROR - Error processing callback for node 69fe6762e4d4e78cd76b2f06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:45:44,214 - lava_callback - INFO - Received callback for node 69fe6787e4d4e78cd76b2f19 INFO: 172.21.0.1:46116 - "POST /node/69fe6787e4d4e78cd76b2f19 HTTP/1.0" 202 Accepted 2026-05-10 22:45:44,220 - lava_callback - INFO - Starting async job submit for node 69fe6787e4d4e78cd76b2f19 2026-05-10 22:45:44,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:45:44,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6787e4d4e78cd76b2f19 HTTP/1.1" 200 None 2026-05-10 22:45:44,235 - lava_callback - DEBUG - Processing node 69fe6787e4d4e78cd76b2f19: baseline-arm-clabbe 2026-05-10 22:45:44,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6787e4d4e78cd76b2f19 2026-05-10 22:45:44,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:45:44,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6787e4d4e78cd76b2f19 HTTP/1.1" 200 None 2026-05-10 22:45:44,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:45:44,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:45:44,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:45:44,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6787e4d4e78cd76b2f19 HTTP/1.1" 200 None 2026-05-10 22:45:44,286 - lava_callback - ERROR - Error processing callback for node 69fe6787e4d4e78cd76b2f19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET /node/690e77ccde2a61e970121ef1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:46:24,374 - lava_callback - INFO - Received callback for node 69fe67aee4d4e78cd76b2f2d INFO: 172.21.0.1:58974 - "POST /node/69fe67aee4d4e78cd76b2f2d HTTP/1.0" 202 Accepted 2026-05-10 22:46:24,379 - lava_callback - INFO - Starting async job submit for node 69fe67aee4d4e78cd76b2f2d 2026-05-10 22:46:24,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:46:24,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe67aee4d4e78cd76b2f2d HTTP/1.1" 200 None 2026-05-10 22:46:24,394 - lava_callback - DEBUG - Processing node 69fe67aee4d4e78cd76b2f2d: baseline-arm-clabbe 2026-05-10 22:46:24,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe67aee4d4e78cd76b2f2d 2026-05-10 22:46:24,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:46:24,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe67aee4d4e78cd76b2f2d HTTP/1.1" 200 None 2026-05-10 22:46:24,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:46:24,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:46:24,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:46:24,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe67aee4d4e78cd76b2f2d HTTP/1.1" 200 None 2026-05-10 22:46:24,442 - lava_callback - ERROR - Error processing callback for node 69fe67aee4d4e78cd76b2f2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:47:04,281 - lava_callback - INFO - Received callback for node 69fe67d5e4d4e78cd76b2f3f INFO: 172.21.0.1:52270 - "POST /node/69fe67d5e4d4e78cd76b2f3f HTTP/1.0" 202 Accepted 2026-05-10 22:47:04,287 - lava_callback - INFO - Starting async job submit for node 69fe67d5e4d4e78cd76b2f3f 2026-05-10 22:47:04,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:47:04,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe67d5e4d4e78cd76b2f3f HTTP/1.1" 200 None 2026-05-10 22:47:04,309 - lava_callback - DEBUG - Processing node 69fe67d5e4d4e78cd76b2f3f: baseline-arm-clabbe 2026-05-10 22:47:04,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe67d5e4d4e78cd76b2f3f 2026-05-10 22:47:04,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:47:04,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe67d5e4d4e78cd76b2f3f HTTP/1.1" 200 None 2026-05-10 22:47:04,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:47:04,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-10 22:47:04,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:47:04,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe67d5e4d4e78cd76b2f3f HTTP/1.1" 200 None 2026-05-10 22:47:04,364 - lava_callback - ERROR - Error processing callback for node 69fe67d5e4d4e78cd76b2f3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34272 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:49:17,356 - lava_callback - INFO - Received callback for node 69fe6866e4d4e78cd76b2f63 INFO: 172.21.0.1:34282 - "POST /node/69fe6866e4d4e78cd76b2f63 HTTP/1.0" 202 Accepted 2026-05-10 22:49:17,361 - lava_callback - INFO - Starting async job submit for node 69fe6866e4d4e78cd76b2f63 2026-05-10 22:49:17,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:49:17,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6866e4d4e78cd76b2f63 HTTP/1.1" 200 None 2026-05-10 22:49:17,387 - lava_callback - DEBUG - Processing node 69fe6866e4d4e78cd76b2f63: baseline-x86 2026-05-10 22:49:17,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6866e4d4e78cd76b2f63 2026-05-10 22:49:17,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:49:17,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6866e4d4e78cd76b2f63 HTTP/1.1" 200 None 2026-05-10 22:49:17,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:49:17,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d56e4d4e78cd76adcf2 HTTP/1.1" 200 None 2026-05-10 22:49:17,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:49:17,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6866e4d4e78cd76b2f63 HTTP/1.1" 200 None 2026-05-10 22:49:17,434 - lava_callback - ERROR - Error processing callback for node 69fe6866e4d4e78cd76b2f63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:59:09,171 - lava_callback - INFO - Received callback for node 6a010d21379c7180ed788374 INFO: 172.21.0.1:60292 - "POST /node/6a010d21379c7180ed788374 HTTP/1.0" 202 Accepted 2026-05-10 22:59:09,177 - lava_callback - INFO - Starting async job submit for node 6a010d21379c7180ed788374 2026-05-10 22:59:09,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:59:09,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a010d21379c7180ed788374 HTTP/1.1" 200 None 2026-05-10 22:59:09,213 - lava_callback - DEBUG - Processing node 6a010d21379c7180ed788374: baseline-arm-broonie 2026-05-10 22:59:09,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 22:59:09,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 22:59:09,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a010d21379c7180ed788374/log.txt.gz 2026-05-10 22:59:09,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 22:59:10,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 22:59:10,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a010d21379c7180ed788374/lava-logs.yaml 2026-05-10 22:59:10,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 22:59:10,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 22:59:10,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a010d21379c7180ed788374/lava_callback.json.gz 2026-05-10 22:59:10,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:59:10,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a010d21379c7180ed788374 HTTP/1.1" 200 None 2026-05-10 22:59:10,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:59:10,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a00af84379c7180ed78397a HTTP/1.1" 200 None 2026-05-10 22:59:10,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:59:10,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a010d21379c7180ed788374 HTTP/1.1" 200 None 2026-05-10 22:59:10,249 - lava_callback - INFO - Completed processing callback for node 6a010d21379c7180ed788374 INFO: 172.21.0.1:59954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59960 - "GET / HTTP/1.0" 200 OK 2026-05-10 22:59:20,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 22:59:20,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:10:49,793 - lava_callback - INFO - Received callback for node 69fe6d6de4d4e78cd76b2fa1 INFO: 172.21.0.1:48480 - "POST /node/69fe6d6de4d4e78cd76b2fa1 HTTP/1.0" 202 Accepted 2026-05-10 23:10:49,798 - lava_callback - INFO - Starting async job submit for node 69fe6d6de4d4e78cd76b2fa1 2026-05-10 23:10:49,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:10:49,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6d6de4d4e78cd76b2fa1 HTTP/1.1" 200 None 2026-05-10 23:10:49,814 - lava_callback - DEBUG - Processing node 69fe6d6de4d4e78cd76b2fa1: baseline-arm-baylibre 2026-05-10 23:10:49,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6d6de4d4e78cd76b2fa1 2026-05-10 23:10:49,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:10:49,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6d6de4d4e78cd76b2fa1 HTTP/1.1" 200 None 2026-05-10 23:10:49,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:10:49,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:10:49,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:10:49,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6d6de4d4e78cd76b2fa1 HTTP/1.1" 200 None 2026-05-10 23:10:49,862 - lava_callback - ERROR - Error processing callback for node 69fe6d6de4d4e78cd76b2fa1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:12:49,884 - lava_callback - INFO - Received callback for node 69fe6de5e4d4e78cd76b2fb9 INFO: 172.21.0.1:59858 - "POST /node/69fe6de5e4d4e78cd76b2fb9 HTTP/1.0" 202 Accepted 2026-05-10 23:12:49,890 - lava_callback - INFO - Starting async job submit for node 69fe6de5e4d4e78cd76b2fb9 2026-05-10 23:12:49,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:12:49,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6de5e4d4e78cd76b2fb9 HTTP/1.1" 200 None 2026-05-10 23:12:49,906 - lava_callback - DEBUG - Processing node 69fe6de5e4d4e78cd76b2fb9: baseline-arm-baylibre 2026-05-10 23:12:49,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6de5e4d4e78cd76b2fb9 2026-05-10 23:12:49,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:12:49,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6de5e4d4e78cd76b2fb9 HTTP/1.1" 200 None 2026-05-10 23:12:49,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:12:49,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:12:49,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:12:49,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6de5e4d4e78cd76b2fb9 HTTP/1.1" 200 None 2026-05-10 23:12:49,953 - lava_callback - ERROR - Error processing callback for node 69fe6de5e4d4e78cd76b2fb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:21:30,772 - lava_callback - INFO - Received callback for node 69fe6ff6e4d4e78cd76b314f INFO: 172.21.0.1:35682 - "POST /node/69fe6ff6e4d4e78cd76b314f HTTP/1.0" 202 Accepted 2026-05-10 23:21:30,777 - lava_callback - INFO - Starting async job submit for node 69fe6ff6e4d4e78cd76b314f 2026-05-10 23:21:30,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:21:30,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6ff6e4d4e78cd76b314f HTTP/1.1" 200 None 2026-05-10 23:21:30,792 - lava_callback - DEBUG - Processing node 69fe6ff6e4d4e78cd76b314f: baseline-arm64-baylibre 2026-05-10 23:21:30,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe6ff6e4d4e78cd76b314f 2026-05-10 23:21:30,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:21:30,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6ff6e4d4e78cd76b314f HTTP/1.1" 200 None 2026-05-10 23:21:30,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:21:30,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:21:30,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:21:30,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6ff6e4d4e78cd76b314f HTTP/1.1" 200 None 2026-05-10 23:21:30,838 - lava_callback - ERROR - Error processing callback for node 69fe6ff6e4d4e78cd76b314f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:22:50,422 - lava_callback - INFO - Received callback for node 69fe7046e4d4e78cd76b317e INFO: 172.21.0.1:51260 - "POST /node/69fe7046e4d4e78cd76b317e HTTP/1.0" 202 Accepted 2026-05-10 23:22:50,432 - lava_callback - INFO - Starting async job submit for node 69fe7046e4d4e78cd76b317e 2026-05-10 23:22:50,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:22:50,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7046e4d4e78cd76b317e HTTP/1.1" 200 None 2026-05-10 23:22:50,448 - lava_callback - DEBUG - Processing node 69fe7046e4d4e78cd76b317e: baseline-arm64-baylibre 2026-05-10 23:22:50,448 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7046e4d4e78cd76b317e 2026-05-10 23:22:50,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:22:50,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7046e4d4e78cd76b317e HTTP/1.1" 200 None 2026-05-10 23:22:50,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:22:50,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:22:50,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:22:50,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7046e4d4e78cd76b317e HTTP/1.1" 200 None 2026-05-10 23:22:50,494 - lava_callback - ERROR - Error processing callback for node 69fe7046e4d4e78cd76b317e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:24:10,478 - lava_callback - INFO - Received callback for node 69fe7097e4d4e78cd76b31bf INFO: 172.21.0.1:49258 - "POST /node/69fe7097e4d4e78cd76b31bf HTTP/1.0" 202 Accepted 2026-05-10 23:24:10,484 - lava_callback - INFO - Starting async job submit for node 69fe7097e4d4e78cd76b31bf 2026-05-10 23:24:10,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:24:10,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7097e4d4e78cd76b31bf HTTP/1.1" 200 None 2026-05-10 23:24:10,502 - lava_callback - DEBUG - Processing node 69fe7097e4d4e78cd76b31bf: baseline-arm64-baylibre 2026-05-10 23:24:10,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7097e4d4e78cd76b31bf 2026-05-10 23:24:10,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:24:10,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7097e4d4e78cd76b31bf HTTP/1.1" 200 None 2026-05-10 23:24:10,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:24:10,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:24:10,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:24:10,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7097e4d4e78cd76b31bf HTTP/1.1" 200 None 2026-05-10 23:24:10,552 - lava_callback - ERROR - Error processing callback for node 69fe7097e4d4e78cd76b31bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:25:50,571 - lava_callback - INFO - Received callback for node 69fe70e9e4d4e78cd76b3204 INFO: 172.21.0.1:51348 - "POST /node/69fe70e9e4d4e78cd76b3204 HTTP/1.0" 202 Accepted 2026-05-10 23:25:50,577 - lava_callback - INFO - Starting async job submit for node 69fe70e9e4d4e78cd76b3204 2026-05-10 23:25:50,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:25:50,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe70e9e4d4e78cd76b3204 HTTP/1.1" 200 None 2026-05-10 23:25:50,592 - lava_callback - DEBUG - Processing node 69fe70e9e4d4e78cd76b3204: baseline-arm64-baylibre 2026-05-10 23:25:50,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe70e9e4d4e78cd76b3204 2026-05-10 23:25:50,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:25:50,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe70e9e4d4e78cd76b3204 HTTP/1.1" 200 None 2026-05-10 23:25:50,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:25:50,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:25:50,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:25:50,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe70e9e4d4e78cd76b3204 HTTP/1.1" 200 None 2026-05-10 23:25:50,638 - lava_callback - ERROR - Error processing callback for node 69fe70e9e4d4e78cd76b3204: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:27:10,634 - lava_callback - INFO - Received callback for node 69fe713ae4d4e78cd76b3222 INFO: 172.21.0.1:43006 - "POST /node/69fe713ae4d4e78cd76b3222 HTTP/1.0" 202 Accepted 2026-05-10 23:27:10,640 - lava_callback - INFO - Starting async job submit for node 69fe713ae4d4e78cd76b3222 2026-05-10 23:27:10,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:27:10,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe713ae4d4e78cd76b3222 HTTP/1.1" 200 None 2026-05-10 23:27:10,655 - lava_callback - DEBUG - Processing node 69fe713ae4d4e78cd76b3222: baseline-arm64-baylibre 2026-05-10 23:27:10,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe713ae4d4e78cd76b3222 2026-05-10 23:27:10,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:27:10,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe713ae4d4e78cd76b3222 HTTP/1.1" 200 None 2026-05-10 23:27:10,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:27:10,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:27:10,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:27:10,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe713ae4d4e78cd76b3222 HTTP/1.1" 200 None 2026-05-10 23:27:10,709 - lava_callback - ERROR - Error processing callback for node 69fe713ae4d4e78cd76b3222: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:28:30,708 - lava_callback - INFO - Received callback for node 69fe718ce4d4e78cd76b3252 INFO: 172.21.0.1:37332 - "POST /node/69fe718ce4d4e78cd76b3252 HTTP/1.0" 202 Accepted 2026-05-10 23:28:30,714 - lava_callback - INFO - Starting async job submit for node 69fe718ce4d4e78cd76b3252 2026-05-10 23:28:30,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:28:30,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe718ce4d4e78cd76b3252 HTTP/1.1" 200 None 2026-05-10 23:28:30,728 - lava_callback - DEBUG - Processing node 69fe718ce4d4e78cd76b3252: baseline-arm64-baylibre 2026-05-10 23:28:30,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe718ce4d4e78cd76b3252 2026-05-10 23:28:30,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:28:30,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe718ce4d4e78cd76b3252 HTTP/1.1" 200 None 2026-05-10 23:28:30,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:28:30,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:28:30,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:28:30,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe718ce4d4e78cd76b3252 HTTP/1.1" 200 None 2026-05-10 23:28:30,779 - lava_callback - ERROR - Error processing callback for node 69fe718ce4d4e78cd76b3252: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:33:46,279 - lava_callback - INFO - Received callback for node 69fe72d2e4d4e78cd76b3303 INFO: 172.21.0.1:34872 - "POST /node/69fe72d2e4d4e78cd76b3303 HTTP/1.0" 202 Accepted 2026-05-10 23:33:46,284 - lava_callback - INFO - Starting async job submit for node 69fe72d2e4d4e78cd76b3303 2026-05-10 23:33:46,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:33:46,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe72d2e4d4e78cd76b3303 HTTP/1.1" 200 None 2026-05-10 23:33:46,301 - lava_callback - DEBUG - Processing node 69fe72d2e4d4e78cd76b3303: baseline-arm64-clabbe 2026-05-10 23:33:46,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe72d2e4d4e78cd76b3303 2026-05-10 23:33:46,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:33:46,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe72d2e4d4e78cd76b3303 HTTP/1.1" 200 None 2026-05-10 23:33:46,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:33:46,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:33:46,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:33:46,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe72d2e4d4e78cd76b3303 HTTP/1.1" 200 None 2026-05-10 23:33:46,348 - lava_callback - ERROR - Error processing callback for node 69fe72d2e4d4e78cd76b3303: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:35:06,317 - lava_callback - INFO - Received callback for node 69fe7323e4d4e78cd76b3334 INFO: 172.21.0.1:37402 - "POST /node/69fe7323e4d4e78cd76b3334 HTTP/1.0" 202 Accepted 2026-05-10 23:35:06,323 - lava_callback - INFO - Starting async job submit for node 69fe7323e4d4e78cd76b3334 2026-05-10 23:35:06,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:35:06,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7323e4d4e78cd76b3334 HTTP/1.1" 200 None 2026-05-10 23:35:06,350 - lava_callback - DEBUG - Processing node 69fe7323e4d4e78cd76b3334: baseline-arm64-clabbe 2026-05-10 23:35:06,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7323e4d4e78cd76b3334 2026-05-10 23:35:06,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:35:06,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7323e4d4e78cd76b3334 HTTP/1.1" 200 None 2026-05-10 23:35:06,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:35:06,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:35:06,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:35:06,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7323e4d4e78cd76b3334 HTTP/1.1" 200 None 2026-05-10 23:35:06,397 - lava_callback - ERROR - Error processing callback for node 69fe7323e4d4e78cd76b3334: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:36:26,376 - lava_callback - INFO - Received callback for node 69fe7373e4d4e78cd76b3357 INFO: 172.21.0.1:54724 - "POST /node/69fe7373e4d4e78cd76b3357 HTTP/1.0" 202 Accepted 2026-05-10 23:36:26,382 - lava_callback - INFO - Starting async job submit for node 69fe7373e4d4e78cd76b3357 2026-05-10 23:36:26,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:36:26,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7373e4d4e78cd76b3357 HTTP/1.1" 200 None 2026-05-10 23:36:26,417 - lava_callback - DEBUG - Processing node 69fe7373e4d4e78cd76b3357: baseline-arm64-clabbe 2026-05-10 23:36:26,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7373e4d4e78cd76b3357 2026-05-10 23:36:26,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:36:26,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7373e4d4e78cd76b3357 HTTP/1.1" 200 None 2026-05-10 23:36:26,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:36:26,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:36:26,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:36:26,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7373e4d4e78cd76b3357 HTTP/1.1" 200 None 2026-05-10 23:36:26,476 - lava_callback - ERROR - Error processing callback for node 69fe7373e4d4e78cd76b3357: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:37:46,427 - lava_callback - INFO - Received callback for node 69fe73c3e4d4e78cd76b3382 INFO: 172.21.0.1:59792 - "POST /node/69fe73c3e4d4e78cd76b3382 HTTP/1.0" 202 Accepted 2026-05-10 23:37:46,434 - lava_callback - INFO - Starting async job submit for node 69fe73c3e4d4e78cd76b3382 2026-05-10 23:37:46,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:37:46,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe73c3e4d4e78cd76b3382 HTTP/1.1" 200 None 2026-05-10 23:37:46,449 - lava_callback - DEBUG - Processing node 69fe73c3e4d4e78cd76b3382: baseline-arm64-clabbe 2026-05-10 23:37:46,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe73c3e4d4e78cd76b3382 2026-05-10 23:37:46,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:37:46,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe73c3e4d4e78cd76b3382 HTTP/1.1" 200 None 2026-05-10 23:37:46,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:37:46,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:37:46,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:37:46,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe73c3e4d4e78cd76b3382 HTTP/1.1" 200 None 2026-05-10 23:37:46,504 - lava_callback - ERROR - Error processing callback for node 69fe73c3e4d4e78cd76b3382: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:39:06,452 - lava_callback - INFO - Received callback for node 69fe7413e4d4e78cd76b33b6 INFO: 172.21.0.1:58034 - "POST /node/69fe7413e4d4e78cd76b33b6 HTTP/1.0" 202 Accepted 2026-05-10 23:39:06,461 - lava_callback - INFO - Starting async job submit for node 69fe7413e4d4e78cd76b33b6 2026-05-10 23:39:06,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:39:06,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7413e4d4e78cd76b33b6 HTTP/1.1" 200 None 2026-05-10 23:39:06,480 - lava_callback - DEBUG - Processing node 69fe7413e4d4e78cd76b33b6: baseline-arm64-clabbe 2026-05-10 23:39:06,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7413e4d4e78cd76b33b6 2026-05-10 23:39:06,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:39:06,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7413e4d4e78cd76b33b6 HTTP/1.1" 200 None 2026-05-10 23:39:06,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:39:06,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:39:06,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:39:06,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7413e4d4e78cd76b33b6 HTTP/1.1" 200 None 2026-05-10 23:39:06,527 - lava_callback - ERROR - Error processing callback for node 69fe7413e4d4e78cd76b33b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:40:26,480 - lava_callback - INFO - Received callback for node 69fe7464e4d4e78cd76b33d7 INFO: 172.21.0.1:33852 - "POST /node/69fe7464e4d4e78cd76b33d7 HTTP/1.0" 202 Accepted 2026-05-10 23:40:26,486 - lava_callback - INFO - Starting async job submit for node 69fe7464e4d4e78cd76b33d7 2026-05-10 23:40:26,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:40:26,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7464e4d4e78cd76b33d7 HTTP/1.1" 200 None 2026-05-10 23:40:26,500 - lava_callback - DEBUG - Processing node 69fe7464e4d4e78cd76b33d7: baseline-arm64-clabbe 2026-05-10 23:40:26,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7464e4d4e78cd76b33d7 2026-05-10 23:40:26,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33854 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:40:26,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7464e4d4e78cd76b33d7 HTTP/1.1" 200 None 2026-05-10 23:40:26,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:40:26,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-10 23:40:26,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:40:26,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7464e4d4e78cd76b33d7 HTTP/1.1" 200 None 2026-05-10 23:40:26,551 - lava_callback - ERROR - Error processing callback for node 69fe7464e4d4e78cd76b33d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:41:46,446 - lava_callback - INFO - Received callback for node 69fe74a5e4d4e78cd76b3406 INFO: 172.21.0.1:57622 - "POST /node/69fe74a5e4d4e78cd76b3406 HTTP/1.0" 202 Accepted 2026-05-10 23:41:46,452 - lava_callback - INFO - Starting async job submit for node 69fe74a5e4d4e78cd76b3406 2026-05-10 23:41:46,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:41:46,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe74a5e4d4e78cd76b3406 HTTP/1.1" 200 None 2026-05-10 23:41:46,467 - lava_callback - DEBUG - Processing node 69fe74a5e4d4e78cd76b3406: baseline-arm-clabbe 2026-05-10 23:41:46,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe74a5e4d4e78cd76b3406 2026-05-10 23:41:46,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:41:46,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe74a5e4d4e78cd76b3406 HTTP/1.1" 200 None 2026-05-10 23:41:46,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:41:46,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:41:46,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:41:46,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe74a5e4d4e78cd76b3406 HTTP/1.1" 200 None 2026-05-10 23:41:46,519 - lava_callback - ERROR - Error processing callback for node 69fe74a5e4d4e78cd76b3406: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:42:06,498 - lava_callback - INFO - Received callback for node 69fe74c9e4d4e78cd76b341a INFO: 172.21.0.1:40346 - "POST /node/69fe74c9e4d4e78cd76b341a HTTP/1.0" 202 Accepted 2026-05-10 23:42:06,505 - lava_callback - INFO - Starting async job submit for node 69fe74c9e4d4e78cd76b341a INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:42:06,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:42:06,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe74c9e4d4e78cd76b341a HTTP/1.1" 200 None 2026-05-10 23:42:06,528 - lava_callback - DEBUG - Processing node 69fe74c9e4d4e78cd76b341a: baseline-arm-clabbe 2026-05-10 23:42:06,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe74c9e4d4e78cd76b341a 2026-05-10 23:42:06,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:42:06,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe74c9e4d4e78cd76b341a HTTP/1.1" 200 None 2026-05-10 23:42:06,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:42:06,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:42:06,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:42:06,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe74c9e4d4e78cd76b341a HTTP/1.1" 200 None 2026-05-10 23:42:06,591 - lava_callback - ERROR - Error processing callback for node 69fe74c9e4d4e78cd76b341a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:42:46,520 - lava_callback - INFO - Received callback for node 69fe74eee4d4e78cd76b3432 INFO: 172.21.0.1:59242 - "POST /node/69fe74eee4d4e78cd76b3432 HTTP/1.0" 202 Accepted 2026-05-10 23:42:46,531 - lava_callback - INFO - Starting async job submit for node 69fe74eee4d4e78cd76b3432 INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:42:46,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:42:46,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe74eee4d4e78cd76b3432 HTTP/1.1" 200 None 2026-05-10 23:42:46,558 - lava_callback - DEBUG - Processing node 69fe74eee4d4e78cd76b3432: baseline-arm-clabbe 2026-05-10 23:42:46,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe74eee4d4e78cd76b3432 2026-05-10 23:42:46,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:42:46,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe74eee4d4e78cd76b3432 HTTP/1.1" 200 None 2026-05-10 23:42:46,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:42:46,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:42:46,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:42:46,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe74eee4d4e78cd76b3432 HTTP/1.1" 200 None 2026-05-10 23:42:46,629 - lava_callback - ERROR - Error processing callback for node 69fe74eee4d4e78cd76b3432: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET /node/6928bef8acdde99814a24ec9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:43:26,543 - lava_callback - INFO - Received callback for node 69fe7512e4d4e78cd76b3447 INFO: 172.21.0.1:46466 - "POST /node/69fe7512e4d4e78cd76b3447 HTTP/1.0" 202 Accepted 2026-05-10 23:43:26,551 - lava_callback - INFO - Starting async job submit for node 69fe7512e4d4e78cd76b3447 2026-05-10 23:43:26,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:43:26,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7512e4d4e78cd76b3447 HTTP/1.1" 200 None 2026-05-10 23:43:26,570 - lava_callback - DEBUG - Processing node 69fe7512e4d4e78cd76b3447: baseline-arm-clabbe 2026-05-10 23:43:26,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7512e4d4e78cd76b3447 2026-05-10 23:43:26,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:43:26,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7512e4d4e78cd76b3447 HTTP/1.1" 200 None 2026-05-10 23:43:26,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:43:26,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:43:26,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:43:26,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7512e4d4e78cd76b3447 HTTP/1.1" 200 None 2026-05-10 23:43:26,635 - lava_callback - ERROR - Error processing callback for node 69fe7512e4d4e78cd76b3447: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:44:06,585 - lava_callback - INFO - Received callback for node 69fe7537e4d4e78cd76b345b INFO: 172.21.0.1:42562 - "POST /node/69fe7537e4d4e78cd76b345b HTTP/1.0" 202 Accepted 2026-05-10 23:44:06,590 - lava_callback - INFO - Starting async job submit for node 69fe7537e4d4e78cd76b345b 2026-05-10 23:44:06,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:44:06,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7537e4d4e78cd76b345b HTTP/1.1" 200 None 2026-05-10 23:44:06,610 - lava_callback - DEBUG - Processing node 69fe7537e4d4e78cd76b345b: baseline-arm-clabbe 2026-05-10 23:44:06,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7537e4d4e78cd76b345b 2026-05-10 23:44:06,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:44:06,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7537e4d4e78cd76b345b HTTP/1.1" 200 None 2026-05-10 23:44:06,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:44:06,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:44:06,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:44:06,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7537e4d4e78cd76b345b HTTP/1.1" 200 None 2026-05-10 23:44:06,660 - lava_callback - ERROR - Error processing callback for node 69fe7537e4d4e78cd76b345b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:44:46,589 - lava_callback - INFO - Received callback for node 69fe755ce4d4e78cd76b347c INFO: 172.21.0.1:53392 - "POST /node/69fe755ce4d4e78cd76b347c HTTP/1.0" 202 Accepted 2026-05-10 23:44:46,595 - lava_callback - INFO - Starting async job submit for node 69fe755ce4d4e78cd76b347c 2026-05-10 23:44:46,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:44:46,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe755ce4d4e78cd76b347c HTTP/1.1" 200 None 2026-05-10 23:44:46,610 - lava_callback - DEBUG - Processing node 69fe755ce4d4e78cd76b347c: baseline-arm-clabbe 2026-05-10 23:44:46,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe755ce4d4e78cd76b347c 2026-05-10 23:44:46,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:44:46,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe755ce4d4e78cd76b347c HTTP/1.1" 200 None 2026-05-10 23:44:46,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:44:46,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:44:46,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:44:46,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe755ce4d4e78cd76b347c HTTP/1.1" 200 None 2026-05-10 23:44:46,660 - lava_callback - ERROR - Error processing callback for node 69fe755ce4d4e78cd76b347c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:45:11,663 - lava_callback - INFO - Received callback for node 69fe757ae4d4e78cd76b3491 INFO: 172.21.0.1:41096 - "POST /node/69fe757ae4d4e78cd76b3491 HTTP/1.0" 202 Accepted 2026-05-10 23:45:11,668 - lava_callback - INFO - Starting async job submit for node 69fe757ae4d4e78cd76b3491 2026-05-10 23:45:11,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:45:11,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe757ae4d4e78cd76b3491 HTTP/1.1" 200 None 2026-05-10 23:45:11,683 - lava_callback - DEBUG - Processing node 69fe757ae4d4e78cd76b3491: baseline-arm-baylibre 2026-05-10 23:45:11,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe757ae4d4e78cd76b3491 2026-05-10 23:45:11,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:45:11,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe757ae4d4e78cd76b3491 HTTP/1.1" 200 None 2026-05-10 23:45:11,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:45:11,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:45:11,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:45:11,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe757ae4d4e78cd76b3491 HTTP/1.1" 200 None 2026-05-10 23:45:11,732 - lava_callback - ERROR - Error processing callback for node 69fe757ae4d4e78cd76b3491: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:45:51,644 - lava_callback - INFO - Received callback for node 69fe759de4d4e78cd76b34a5 INFO: 172.21.0.1:37658 - "POST /node/69fe759de4d4e78cd76b34a5 HTTP/1.0" 202 Accepted 2026-05-10 23:45:51,651 - lava_callback - INFO - Starting async job submit for node 69fe759de4d4e78cd76b34a5 2026-05-10 23:45:51,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:45:51,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe759de4d4e78cd76b34a5 HTTP/1.1" 200 None 2026-05-10 23:45:51,689 - lava_callback - DEBUG - Processing node 69fe759de4d4e78cd76b34a5: baseline-arm-baylibre 2026-05-10 23:45:51,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe759de4d4e78cd76b34a5 2026-05-10 23:45:51,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:45:51,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe759de4d4e78cd76b34a5 HTTP/1.1" 200 None 2026-05-10 23:45:51,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:45:51,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:45:51,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:45:51,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe759de4d4e78cd76b34a5 HTTP/1.1" 200 None 2026-05-10 23:45:51,741 - lava_callback - ERROR - Error processing callback for node 69fe759de4d4e78cd76b34a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:46:11,646 - lava_callback - INFO - Received callback for node 69fe75c1e4d4e78cd76b34ba INFO: 172.21.0.1:43500 - "POST /node/69fe75c1e4d4e78cd76b34ba HTTP/1.0" 202 Accepted 2026-05-10 23:46:11,652 - lava_callback - INFO - Starting async job submit for node 69fe75c1e4d4e78cd76b34ba 2026-05-10 23:46:11,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:46:11,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe75c1e4d4e78cd76b34ba HTTP/1.1" 200 None 2026-05-10 23:46:11,667 - lava_callback - DEBUG - Processing node 69fe75c1e4d4e78cd76b34ba: baseline-arm-baylibre 2026-05-10 23:46:11,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe75c1e4d4e78cd76b34ba 2026-05-10 23:46:11,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:46:11,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe75c1e4d4e78cd76b34ba HTTP/1.1" 200 None 2026-05-10 23:46:11,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:46:11,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:46:11,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:46:11,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe75c1e4d4e78cd76b34ba HTTP/1.1" 200 None 2026-05-10 23:46:11,725 - lava_callback - ERROR - Error processing callback for node 69fe75c1e4d4e78cd76b34ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41960 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:46:51,695 - lava_callback - INFO - Received callback for node 69fe75e5e4d4e78cd76b34ca INFO: 172.21.0.1:44808 - "POST /node/69fe75e5e4d4e78cd76b34ca HTTP/1.0" 202 Accepted 2026-05-10 23:46:51,705 - lava_callback - INFO - Starting async job submit for node 69fe75e5e4d4e78cd76b34ca 2026-05-10 23:46:51,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:46:51,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe75e5e4d4e78cd76b34ca HTTP/1.1" 200 None 2026-05-10 23:46:51,728 - lava_callback - DEBUG - Processing node 69fe75e5e4d4e78cd76b34ca: baseline-arm-baylibre 2026-05-10 23:46:51,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe75e5e4d4e78cd76b34ca 2026-05-10 23:46:51,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:46:51,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe75e5e4d4e78cd76b34ca HTTP/1.1" 200 None 2026-05-10 23:46:51,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:46:51,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:46:51,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:46:51,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe75e5e4d4e78cd76b34ca HTTP/1.1" 200 None 2026-05-10 23:46:51,795 - lava_callback - ERROR - Error processing callback for node 69fe75e5e4d4e78cd76b34ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52074 - "GET /node/69943ab85ae459b9df3d55d1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52088 - "GET /node/69f2ab8ae2fa3d7693ba727b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:47:31,765 - lava_callback - INFO - Received callback for node 69fe7608e4d4e78cd76b34dc INFO: 172.21.0.1:34430 - "POST /node/69fe7608e4d4e78cd76b34dc HTTP/1.0" 202 Accepted 2026-05-10 23:47:31,770 - lava_callback - INFO - Starting async job submit for node 69fe7608e4d4e78cd76b34dc 2026-05-10 23:47:31,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:47:31,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7608e4d4e78cd76b34dc HTTP/1.1" 200 None 2026-05-10 23:47:31,785 - lava_callback - DEBUG - Processing node 69fe7608e4d4e78cd76b34dc: baseline-arm-baylibre 2026-05-10 23:47:31,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7608e4d4e78cd76b34dc 2026-05-10 23:47:31,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:47:31,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7608e4d4e78cd76b34dc HTTP/1.1" 200 None 2026-05-10 23:47:31,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:47:31,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:47:31,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:47:31,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7608e4d4e78cd76b34dc HTTP/1.1" 200 None 2026-05-10 23:47:31,843 - lava_callback - ERROR - Error processing callback for node 69fe7608e4d4e78cd76b34dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:48:06,703 - lava_callback - INFO - Received callback for node 69fe762de4d4e78cd76b34fb INFO: 172.21.0.1:44226 - "POST /node/69fe762de4d4e78cd76b34fb HTTP/1.0" 202 Accepted 2026-05-10 23:48:06,709 - lava_callback - INFO - Starting async job submit for node 69fe762de4d4e78cd76b34fb 2026-05-10 23:48:06,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:48:06,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe762de4d4e78cd76b34fb HTTP/1.1" 200 None 2026-05-10 23:48:06,726 - lava_callback - DEBUG - Processing node 69fe762de4d4e78cd76b34fb: baseline-arm-clabbe 2026-05-10 23:48:06,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe762de4d4e78cd76b34fb 2026-05-10 23:48:06,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:48:06,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe762de4d4e78cd76b34fb HTTP/1.1" 200 None 2026-05-10 23:48:06,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:48:06,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:48:06,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:48:06,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe762de4d4e78cd76b34fb HTTP/1.1" 200 None 2026-05-10 23:48:06,779 - lava_callback - ERROR - Error processing callback for node 69fe762de4d4e78cd76b34fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:48:51,829 - lava_callback - INFO - Received callback for node 69fe764fe4d4e78cd76b350f INFO: 172.21.0.1:40458 - "POST /node/69fe764fe4d4e78cd76b350f HTTP/1.0" 202 Accepted 2026-05-10 23:48:51,834 - lava_callback - INFO - Starting async job submit for node 69fe764fe4d4e78cd76b350f 2026-05-10 23:48:51,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:48:51,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe764fe4d4e78cd76b350f HTTP/1.1" 200 None 2026-05-10 23:48:51,850 - lava_callback - DEBUG - Processing node 69fe764fe4d4e78cd76b350f: baseline-arm-baylibre 2026-05-10 23:48:51,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe764fe4d4e78cd76b350f 2026-05-10 23:48:51,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:48:51,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe764fe4d4e78cd76b350f HTTP/1.1" 200 None 2026-05-10 23:48:51,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:48:51,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:48:51,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:48:51,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe764fe4d4e78cd76b350f HTTP/1.1" 200 None 2026-05-10 23:48:51,899 - lava_callback - ERROR - Error processing callback for node 69fe764fe4d4e78cd76b350f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:49:11,825 - lava_callback - INFO - Received callback for node 69fe766fe4d4e78cd76b3524 INFO: 172.21.0.1:41122 - "POST /node/69fe766fe4d4e78cd76b3524 HTTP/1.0" 202 Accepted 2026-05-10 23:49:11,830 - lava_callback - INFO - Starting async job submit for node 69fe766fe4d4e78cd76b3524 2026-05-10 23:49:11,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:49:11,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe766fe4d4e78cd76b3524 HTTP/1.1" 200 None 2026-05-10 23:49:11,846 - lava_callback - DEBUG - Processing node 69fe766fe4d4e78cd76b3524: baseline-arm-baylibre 2026-05-10 23:49:11,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe766fe4d4e78cd76b3524 2026-05-10 23:49:11,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:49:11,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe766fe4d4e78cd76b3524 HTTP/1.1" 200 None 2026-05-10 23:49:11,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:49:11,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:49:11,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:49:11,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe766fe4d4e78cd76b3524 HTTP/1.1" 200 None 2026-05-10 23:49:11,895 - lava_callback - ERROR - Error processing callback for node 69fe766fe4d4e78cd76b3524: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET /node/69f3a9bd2fa6ff8e8ca918f0%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-10 23:49:51,849 - lava_callback - INFO - Received callback for node 69fe7692e4d4e78cd76b3539 INFO: 172.21.0.1:52916 - "POST /node/69fe7692e4d4e78cd76b3539 HTTP/1.0" 202 Accepted 2026-05-10 23:49:51,855 - lava_callback - INFO - Starting async job submit for node 69fe7692e4d4e78cd76b3539 2026-05-10 23:49:51,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:49:51,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7692e4d4e78cd76b3539 HTTP/1.1" 200 None 2026-05-10 23:49:51,870 - lava_callback - DEBUG - Processing node 69fe7692e4d4e78cd76b3539: baseline-arm-baylibre 2026-05-10 23:49:51,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7692e4d4e78cd76b3539 2026-05-10 23:49:51,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:49:51,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7692e4d4e78cd76b3539 HTTP/1.1" 200 None 2026-05-10 23:49:51,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:49:51,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:49:51,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:49:51,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7692e4d4e78cd76b3539 HTTP/1.1" 200 None 2026-05-10 23:49:51,923 - lava_callback - ERROR - Error processing callback for node 69fe7692e4d4e78cd76b3539: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45058 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:50:26,812 - lava_callback - INFO - Received callback for node 69fe76b9e4d4e78cd76b3547 INFO: 172.21.0.1:45060 - "POST /node/69fe76b9e4d4e78cd76b3547 HTTP/1.0" 202 Accepted 2026-05-10 23:50:26,818 - lava_callback - INFO - Starting async job submit for node 69fe76b9e4d4e78cd76b3547 2026-05-10 23:50:26,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:50:26,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe76b9e4d4e78cd76b3547 HTTP/1.1" 200 None 2026-05-10 23:50:26,833 - lava_callback - DEBUG - Processing node 69fe76b9e4d4e78cd76b3547: baseline-arm-clabbe 2026-05-10 23:50:26,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe76b9e4d4e78cd76b3547 2026-05-10 23:50:26,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:50:26,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe76b9e4d4e78cd76b3547 HTTP/1.1" 200 None 2026-05-10 23:50:26,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:50:26,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:50:26,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:50:26,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe76b9e4d4e78cd76b3547 HTTP/1.1" 200 None 2026-05-10 23:50:26,879 - lava_callback - ERROR - Error processing callback for node 69fe76b9e4d4e78cd76b3547: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:50:51,944 - lava_callback - INFO - Received callback for node 69fe76d9e4d4e78cd76b3558 INFO: 172.21.0.1:39282 - "POST /node/69fe76d9e4d4e78cd76b3558 HTTP/1.0" 202 Accepted 2026-05-10 23:50:51,950 - lava_callback - INFO - Starting async job submit for node 69fe76d9e4d4e78cd76b3558 2026-05-10 23:50:51,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:50:51,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe76d9e4d4e78cd76b3558 HTTP/1.1" 200 None 2026-05-10 23:50:51,964 - lava_callback - DEBUG - Processing node 69fe76d9e4d4e78cd76b3558: baseline-arm-baylibre 2026-05-10 23:50:51,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe76d9e4d4e78cd76b3558 2026-05-10 23:50:51,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:50:51,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe76d9e4d4e78cd76b3558 HTTP/1.1" 200 None 2026-05-10 23:50:51,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:50:51,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:50:51,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:50:52,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe76d9e4d4e78cd76b3558 HTTP/1.1" 200 None 2026-05-10 23:50:52,025 - lava_callback - ERROR - Error processing callback for node 69fe76d9e4d4e78cd76b3558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:51:46,916 - lava_callback - INFO - Received callback for node 69fe7700e4d4e78cd76b3579 INFO: 172.21.0.1:60484 - "POST /node/69fe7700e4d4e78cd76b3579 HTTP/1.0" 202 Accepted 2026-05-10 23:51:46,922 - lava_callback - INFO - Starting async job submit for node 69fe7700e4d4e78cd76b3579 2026-05-10 23:51:46,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:51:46,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7700e4d4e78cd76b3579 HTTP/1.1" 200 None 2026-05-10 23:51:46,936 - lava_callback - DEBUG - Processing node 69fe7700e4d4e78cd76b3579: baseline-arm-clabbe 2026-05-10 23:51:46,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7700e4d4e78cd76b3579 2026-05-10 23:51:46,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:51:46,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7700e4d4e78cd76b3579 HTTP/1.1" 200 None 2026-05-10 23:51:46,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:51:46,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:51:46,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:51:46,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7700e4d4e78cd76b3579 HTTP/1.1" 200 None 2026-05-10 23:51:46,980 - lava_callback - ERROR - Error processing callback for node 69fe7700e4d4e78cd76b3579: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36310 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:52:12,084 - lava_callback - INFO - Received callback for node 69fe7720e4d4e78cd76b358b INFO: 172.21.0.1:42488 - "POST /node/69fe7720e4d4e78cd76b358b HTTP/1.0" 202 Accepted 2026-05-10 23:52:12,090 - lava_callback - INFO - Starting async job submit for node 69fe7720e4d4e78cd76b358b 2026-05-10 23:52:12,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:52:12,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7720e4d4e78cd76b358b HTTP/1.1" 200 None 2026-05-10 23:52:12,105 - lava_callback - DEBUG - Processing node 69fe7720e4d4e78cd76b358b: baseline-arm-baylibre 2026-05-10 23:52:12,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7720e4d4e78cd76b358b 2026-05-10 23:52:12,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:52:12,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7720e4d4e78cd76b358b HTTP/1.1" 200 None 2026-05-10 23:52:12,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:52:12,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:52:12,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:52:12,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7720e4d4e78cd76b358b HTTP/1.1" 200 None 2026-05-10 23:52:12,152 - lava_callback - ERROR - Error processing callback for node 69fe7720e4d4e78cd76b358b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET /node/697ab1ea79032e239ba0fd61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:52:52,003 - lava_callback - INFO - Received callback for node 69fe7743e4d4e78cd76b35a0 INFO: 172.21.0.1:58994 - "POST /node/69fe7743e4d4e78cd76b35a0 HTTP/1.0" 202 Accepted 2026-05-10 23:52:52,009 - lava_callback - INFO - Starting async job submit for node 69fe7743e4d4e78cd76b35a0 2026-05-10 23:52:52,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:52:52,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7743e4d4e78cd76b35a0 HTTP/1.1" 200 None 2026-05-10 23:52:52,024 - lava_callback - DEBUG - Processing node 69fe7743e4d4e78cd76b35a0: baseline-arm-baylibre 2026-05-10 23:52:52,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7743e4d4e78cd76b35a0 2026-05-10 23:52:52,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:52:52,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7743e4d4e78cd76b35a0 HTTP/1.1" 200 None 2026-05-10 23:52:52,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:52:52,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:52:52,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:52:52,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7743e4d4e78cd76b35a0 HTTP/1.1" 200 None 2026-05-10 23:52:52,120 - lava_callback - ERROR - Error processing callback for node 69fe7743e4d4e78cd76b35a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:53:26,914 - lava_callback - INFO - Received callback for node 69fe7767e4d4e78cd76b35b6 INFO: 172.21.0.1:38488 - "POST /node/69fe7767e4d4e78cd76b35b6 HTTP/1.0" 202 Accepted 2026-05-10 23:53:26,920 - lava_callback - INFO - Starting async job submit for node 69fe7767e4d4e78cd76b35b6 2026-05-10 23:53:26,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:53:26,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7767e4d4e78cd76b35b6 HTTP/1.1" 200 None 2026-05-10 23:53:26,935 - lava_callback - DEBUG - Processing node 69fe7767e4d4e78cd76b35b6: baseline-arm-clabbe 2026-05-10 23:53:26,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7767e4d4e78cd76b35b6 2026-05-10 23:53:26,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:53:26,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7767e4d4e78cd76b35b6 HTTP/1.1" 200 None 2026-05-10 23:53:26,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:53:26,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:53:26,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:53:26,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7767e4d4e78cd76b35b6 HTTP/1.1" 200 None 2026-05-10 23:53:26,985 - lava_callback - ERROR - Error processing callback for node 69fe7767e4d4e78cd76b35b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40062 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:54:06,909 - lava_callback - INFO - Received callback for node 69fe778ae4d4e78cd76b35c6 INFO: 172.21.0.1:40078 - "POST /node/69fe778ae4d4e78cd76b35c6 HTTP/1.0" 202 Accepted 2026-05-10 23:54:06,914 - lava_callback - INFO - Starting async job submit for node 69fe778ae4d4e78cd76b35c6 2026-05-10 23:54:06,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:54:06,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe778ae4d4e78cd76b35c6 HTTP/1.1" 200 None 2026-05-10 23:54:06,933 - lava_callback - DEBUG - Processing node 69fe778ae4d4e78cd76b35c6: baseline-arm-clabbe 2026-05-10 23:54:06,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe778ae4d4e78cd76b35c6 2026-05-10 23:54:06,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:54:06,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe778ae4d4e78cd76b35c6 HTTP/1.1" 200 None 2026-05-10 23:54:06,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:54:06,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:54:06,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:54:06,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe778ae4d4e78cd76b35c6 HTTP/1.1" 200 None 2026-05-10 23:54:06,978 - lava_callback - ERROR - Error processing callback for node 69fe778ae4d4e78cd76b35c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40300 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:54:32,118 - lava_callback - INFO - Received callback for node 69fe77ade4d4e78cd76b35d6 INFO: 172.21.0.1:39006 - "POST /node/69fe77ade4d4e78cd76b35d6 HTTP/1.0" 202 Accepted 2026-05-10 23:54:32,124 - lava_callback - INFO - Starting async job submit for node 69fe77ade4d4e78cd76b35d6 2026-05-10 23:54:32,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:54:32,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe77ade4d4e78cd76b35d6 HTTP/1.1" 200 None 2026-05-10 23:54:32,138 - lava_callback - DEBUG - Processing node 69fe77ade4d4e78cd76b35d6: baseline-arm-baylibre 2026-05-10 23:54:32,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe77ade4d4e78cd76b35d6 2026-05-10 23:54:32,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:54:32,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe77ade4d4e78cd76b35d6 HTTP/1.1" 200 None 2026-05-10 23:54:32,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:54:32,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:54:32,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:54:32,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe77ade4d4e78cd76b35d6 HTTP/1.1" 200 None 2026-05-10 23:54:32,183 - lava_callback - ERROR - Error processing callback for node 69fe77ade4d4e78cd76b35d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:55:06,985 - lava_callback - INFO - Received callback for node 69fe77d0e4d4e78cd76b35f6 INFO: 172.21.0.1:45648 - "POST /node/69fe77d0e4d4e78cd76b35f6 HTTP/1.0" 202 Accepted 2026-05-10 23:55:06,991 - lava_callback - INFO - Starting async job submit for node 69fe77d0e4d4e78cd76b35f6 2026-05-10 23:55:06,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:55:07,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe77d0e4d4e78cd76b35f6 HTTP/1.1" 200 None 2026-05-10 23:55:07,012 - lava_callback - DEBUG - Processing node 69fe77d0e4d4e78cd76b35f6: baseline-arm-clabbe 2026-05-10 23:55:07,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe77d0e4d4e78cd76b35f6 2026-05-10 23:55:07,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:55:07,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe77d0e4d4e78cd76b35f6 HTTP/1.1" 200 None 2026-05-10 23:55:07,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:55:07,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:55:07,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:55:07,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe77d0e4d4e78cd76b35f6 HTTP/1.1" 200 None 2026-05-10 23:55:07,068 - lava_callback - ERROR - Error processing callback for node 69fe77d0e4d4e78cd76b35f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:55:46,948 - lava_callback - INFO - Received callback for node 69fe77f4e4d4e78cd76b3608 INFO: 172.21.0.1:57710 - "POST /node/69fe77f4e4d4e78cd76b3608 HTTP/1.0" 202 Accepted 2026-05-10 23:55:46,953 - lava_callback - INFO - Starting async job submit for node 69fe77f4e4d4e78cd76b3608 2026-05-10 23:55:46,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:55:46,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe77f4e4d4e78cd76b3608 HTTP/1.1" 200 None 2026-05-10 23:55:46,969 - lava_callback - DEBUG - Processing node 69fe77f4e4d4e78cd76b3608: baseline-arm-clabbe 2026-05-10 23:55:46,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe77f4e4d4e78cd76b3608 2026-05-10 23:55:46,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:55:46,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe77f4e4d4e78cd76b3608 HTTP/1.1" 200 None 2026-05-10 23:55:46,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:55:46,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:55:46,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:55:47,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe77f4e4d4e78cd76b3608 HTTP/1.1" 200 None 2026-05-10 23:55:47,022 - lava_callback - ERROR - Error processing callback for node 69fe77f4e4d4e78cd76b3608: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:56:27,037 - lava_callback - INFO - Received callback for node 69fe7818e4d4e78cd76b361c INFO: 172.21.0.1:60636 - "POST /node/69fe7818e4d4e78cd76b361c HTTP/1.0" 202 Accepted 2026-05-10 23:56:27,043 - lava_callback - INFO - Starting async job submit for node 69fe7818e4d4e78cd76b361c 2026-05-10 23:56:27,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:56:27,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7818e4d4e78cd76b361c HTTP/1.1" 200 None 2026-05-10 23:56:27,057 - lava_callback - DEBUG - Processing node 69fe7818e4d4e78cd76b361c: baseline-arm-clabbe 2026-05-10 23:56:27,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7818e4d4e78cd76b361c 2026-05-10 23:56:27,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:56:27,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7818e4d4e78cd76b361c HTTP/1.1" 200 None 2026-05-10 23:56:27,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:56:27,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:56:27,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:56:27,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7818e4d4e78cd76b361c HTTP/1.1" 200 None 2026-05-10 23:56:27,117 - lava_callback - ERROR - Error processing callback for node 69fe7818e4d4e78cd76b361c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:56:47,018 - lava_callback - INFO - Received callback for node 69fe783be4d4e78cd76b3631 INFO: 172.21.0.1:42216 - "POST /node/69fe783be4d4e78cd76b3631 HTTP/1.0" 202 Accepted 2026-05-10 23:56:47,024 - lava_callback - INFO - Starting async job submit for node 69fe783be4d4e78cd76b3631 2026-05-10 23:56:47,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:56:47,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe783be4d4e78cd76b3631 HTTP/1.1" 200 None 2026-05-10 23:56:47,045 - lava_callback - DEBUG - Processing node 69fe783be4d4e78cd76b3631: baseline-arm-clabbe 2026-05-10 23:56:47,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe783be4d4e78cd76b3631 2026-05-10 23:56:47,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:56:47,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe783be4d4e78cd76b3631 HTTP/1.1" 200 None 2026-05-10 23:56:47,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:56:47,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:56:47,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:56:47,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe783be4d4e78cd76b3631 HTTP/1.1" 200 None 2026-05-10 23:56:47,095 - lava_callback - ERROR - Error processing callback for node 69fe783be4d4e78cd76b3631: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:57:27,061 - lava_callback - INFO - Received callback for node 69fe7862e4d4e78cd76b3640 INFO: 172.21.0.1:41764 - "POST /node/69fe7862e4d4e78cd76b3640 HTTP/1.0" 202 Accepted 2026-05-10 23:57:27,066 - lava_callback - INFO - Starting async job submit for node 69fe7862e4d4e78cd76b3640 2026-05-10 23:57:27,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:57:27,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7862e4d4e78cd76b3640 HTTP/1.1" 200 None 2026-05-10 23:57:27,082 - lava_callback - DEBUG - Processing node 69fe7862e4d4e78cd76b3640: baseline-arm-clabbe 2026-05-10 23:57:27,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7862e4d4e78cd76b3640 2026-05-10 23:57:27,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:57:27,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7862e4d4e78cd76b3640 HTTP/1.1" 200 None 2026-05-10 23:57:27,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:57:27,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:57:27,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:57:27,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7862e4d4e78cd76b3640 HTTP/1.1" 200 None 2026-05-10 23:57:27,131 - lava_callback - ERROR - Error processing callback for node 69fe7862e4d4e78cd76b3640: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:58:07,052 - lava_callback - INFO - Received callback for node 69fe7884e4d4e78cd76b365e INFO: 172.21.0.1:37418 - "POST /node/69fe7884e4d4e78cd76b365e HTTP/1.0" 202 Accepted 2026-05-10 23:58:07,058 - lava_callback - INFO - Starting async job submit for node 69fe7884e4d4e78cd76b365e 2026-05-10 23:58:07,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:58:07,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7884e4d4e78cd76b365e HTTP/1.1" 200 None 2026-05-10 23:58:07,073 - lava_callback - DEBUG - Processing node 69fe7884e4d4e78cd76b365e: baseline-arm-clabbe 2026-05-10 23:58:07,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7884e4d4e78cd76b365e 2026-05-10 23:58:07,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:58:07,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7884e4d4e78cd76b365e HTTP/1.1" 200 None 2026-05-10 23:58:07,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:58:07,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:58:07,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:58:07,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7884e4d4e78cd76b365e HTTP/1.1" 200 None 2026-05-10 23:58:07,122 - lava_callback - ERROR - Error processing callback for node 69fe7884e4d4e78cd76b365e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK 2026-05-10 23:58:47,107 - lava_callback - INFO - Received callback for node 69fe78a7e4d4e78cd76b3670 INFO: 172.21.0.1:34450 - "POST /node/69fe78a7e4d4e78cd76b3670 HTTP/1.0" 202 Accepted 2026-05-10 23:58:47,114 - lava_callback - INFO - Starting async job submit for node 69fe78a7e4d4e78cd76b3670 2026-05-10 23:58:47,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:58:47,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe78a7e4d4e78cd76b3670 HTTP/1.1" 200 None 2026-05-10 23:58:47,130 - lava_callback - DEBUG - Processing node 69fe78a7e4d4e78cd76b3670: baseline-arm-clabbe 2026-05-10 23:58:47,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe78a7e4d4e78cd76b3670 2026-05-10 23:58:47,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:58:47,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe78a7e4d4e78cd76b3670 HTTP/1.1" 200 None 2026-05-10 23:58:47,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:58:47,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-10 23:58:47,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 23:58:47,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe78a7e4d4e78cd76b3670 HTTP/1.1" 200 None 2026-05-10 23:58:47,189 - lava_callback - ERROR - Error processing callback for node 69fe78a7e4d4e78cd76b3670: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK 2026-05-11 00:03:33,049 - lava_callback - INFO - Received callback for node 69fe79d1e4d4e78cd76b368f INFO: 172.21.0.1:60450 - "POST /node/69fe79d1e4d4e78cd76b368f HTTP/1.0" 202 Accepted 2026-05-11 00:03:33,055 - lava_callback - INFO - Starting async job submit for node 69fe79d1e4d4e78cd76b368f 2026-05-11 00:03:33,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:03:33,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe79d1e4d4e78cd76b368f HTTP/1.1" 200 None 2026-05-11 00:03:33,073 - lava_callback - DEBUG - Processing node 69fe79d1e4d4e78cd76b368f: baseline-arm64-baylibre 2026-05-11 00:03:33,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe79d1e4d4e78cd76b368f 2026-05-11 00:03:33,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:03:33,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe79d1e4d4e78cd76b368f HTTP/1.1" 200 None 2026-05-11 00:03:33,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:03:33,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-11 00:03:33,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:03:33,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe79d1e4d4e78cd76b368f HTTP/1.1" 200 None 2026-05-11 00:03:33,134 - lava_callback - ERROR - Error processing callback for node 69fe79d1e4d4e78cd76b368f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK 2026-05-11 00:04:52,665 - lava_callback - INFO - Received callback for node 69fe7a20e4d4e78cd76b36b0 INFO: 172.21.0.1:45840 - "POST /node/69fe7a20e4d4e78cd76b36b0 HTTP/1.0" 202 Accepted 2026-05-11 00:04:52,673 - lava_callback - INFO - Starting async job submit for node 69fe7a20e4d4e78cd76b36b0 2026-05-11 00:04:52,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:04:52,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7a20e4d4e78cd76b36b0 HTTP/1.1" 200 None 2026-05-11 00:04:52,689 - lava_callback - DEBUG - Processing node 69fe7a20e4d4e78cd76b36b0: baseline-arm64-baylibre 2026-05-11 00:04:52,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7a20e4d4e78cd76b36b0 2026-05-11 00:04:52,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:04:52,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7a20e4d4e78cd76b36b0 HTTP/1.1" 200 None 2026-05-11 00:04:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:04:52,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-11 00:04:52,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:04:52,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7a20e4d4e78cd76b36b0 HTTP/1.1" 200 None 2026-05-11 00:04:52,738 - lava_callback - ERROR - Error processing callback for node 69fe7a20e4d4e78cd76b36b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK 2026-05-11 00:06:12,791 - lava_callback - INFO - Received callback for node 69fe7a70e4d4e78cd76b36db INFO: 172.21.0.1:60176 - "POST /node/69fe7a70e4d4e78cd76b36db HTTP/1.0" 202 Accepted 2026-05-11 00:06:12,797 - lava_callback - INFO - Starting async job submit for node 69fe7a70e4d4e78cd76b36db 2026-05-11 00:06:12,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:06:12,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7a70e4d4e78cd76b36db HTTP/1.1" 200 None 2026-05-11 00:06:12,812 - lava_callback - DEBUG - Processing node 69fe7a70e4d4e78cd76b36db: baseline-arm64-baylibre 2026-05-11 00:06:12,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7a70e4d4e78cd76b36db 2026-05-11 00:06:12,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:06:12,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7a70e4d4e78cd76b36db HTTP/1.1" 200 None 2026-05-11 00:06:12,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:06:12,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-11 00:06:12,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:06:12,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7a70e4d4e78cd76b36db HTTP/1.1" 200 None 2026-05-11 00:06:12,858 - lava_callback - ERROR - Error processing callback for node 69fe7a70e4d4e78cd76b36db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET / HTTP/1.0" 200 OK 2026-05-11 00:07:32,882 - lava_callback - INFO - Received callback for node 69fe7ac0e4d4e78cd76b3707 INFO: 172.21.0.1:33596 - "POST /node/69fe7ac0e4d4e78cd76b3707 HTTP/1.0" 202 Accepted 2026-05-11 00:07:32,887 - lava_callback - INFO - Starting async job submit for node 69fe7ac0e4d4e78cd76b3707 2026-05-11 00:07:32,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:07:32,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7ac0e4d4e78cd76b3707 HTTP/1.1" 200 None 2026-05-11 00:07:32,903 - lava_callback - DEBUG - Processing node 69fe7ac0e4d4e78cd76b3707: baseline-arm64-baylibre 2026-05-11 00:07:32,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7ac0e4d4e78cd76b3707 2026-05-11 00:07:32,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:07:32,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7ac0e4d4e78cd76b3707 HTTP/1.1" 200 None 2026-05-11 00:07:32,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:07:32,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-11 00:07:32,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:07:32,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7ac0e4d4e78cd76b3707 HTTP/1.1" 200 None 2026-05-11 00:07:32,947 - lava_callback - ERROR - Error processing callback for node 69fe7ac0e4d4e78cd76b3707: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK 2026-05-11 00:08:52,985 - lava_callback - INFO - Received callback for node 69fe7b0fe4d4e78cd76b3732 INFO: 172.21.0.1:52374 - "POST /node/69fe7b0fe4d4e78cd76b3732 HTTP/1.0" 202 Accepted 2026-05-11 00:08:52,990 - lava_callback - INFO - Starting async job submit for node 69fe7b0fe4d4e78cd76b3732 2026-05-11 00:08:52,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:08:53,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7b0fe4d4e78cd76b3732 HTTP/1.1" 200 None 2026-05-11 00:08:53,010 - lava_callback - DEBUG - Processing node 69fe7b0fe4d4e78cd76b3732: baseline-arm64-baylibre 2026-05-11 00:08:53,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7b0fe4d4e78cd76b3732 2026-05-11 00:08:53,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:08:53,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7b0fe4d4e78cd76b3732 HTTP/1.1" 200 None 2026-05-11 00:08:53,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:08:53,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-11 00:08:53,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:08:53,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7b0fe4d4e78cd76b3732 HTTP/1.1" 200 None 2026-05-11 00:08:53,064 - lava_callback - ERROR - Error processing callback for node 69fe7b0fe4d4e78cd76b3732: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK 2026-05-11 00:10:12,993 - lava_callback - INFO - Received callback for node 69fe7b5fe4d4e78cd76b3783 INFO: 172.21.0.1:50310 - "POST /node/69fe7b5fe4d4e78cd76b3783 HTTP/1.0" 202 Accepted 2026-05-11 00:10:12,998 - lava_callback - INFO - Starting async job submit for node 69fe7b5fe4d4e78cd76b3783 2026-05-11 00:10:12,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:10:13,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7b5fe4d4e78cd76b3783 HTTP/1.1" 200 None 2026-05-11 00:10:13,014 - lava_callback - DEBUG - Processing node 69fe7b5fe4d4e78cd76b3783: baseline-arm64-baylibre 2026-05-11 00:10:13,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7b5fe4d4e78cd76b3783 2026-05-11 00:10:13,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:10:13,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7b5fe4d4e78cd76b3783 HTTP/1.1" 200 None 2026-05-11 00:10:13,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:10:13,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-11 00:10:13,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:10:13,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7b5fe4d4e78cd76b3783 HTTP/1.1" 200 None 2026-05-11 00:10:13,063 - lava_callback - ERROR - Error processing callback for node 69fe7b5fe4d4e78cd76b3783: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK 2026-05-11 00:11:33,096 - lava_callback - INFO - Received callback for node 69fe7bafe4d4e78cd76b37c5 INFO: 172.21.0.1:38040 - "POST /node/69fe7bafe4d4e78cd76b37c5 HTTP/1.0" 202 Accepted 2026-05-11 00:11:33,102 - lava_callback - INFO - Starting async job submit for node 69fe7bafe4d4e78cd76b37c5 2026-05-11 00:11:33,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:11:33,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7bafe4d4e78cd76b37c5 HTTP/1.1" 200 None 2026-05-11 00:11:33,118 - lava_callback - DEBUG - Processing node 69fe7bafe4d4e78cd76b37c5: baseline-arm64-baylibre 2026-05-11 00:11:33,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7bafe4d4e78cd76b37c5 2026-05-11 00:11:33,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:11:33,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7bafe4d4e78cd76b37c5 HTTP/1.1" 200 None 2026-05-11 00:11:33,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:11:33,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-11 00:11:33,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:11:33,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7bafe4d4e78cd76b37c5 HTTP/1.1" 200 None 2026-05-11 00:11:33,163 - lava_callback - ERROR - Error processing callback for node 69fe7bafe4d4e78cd76b37c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK 2026-05-11 00:13:13,264 - lava_callback - INFO - Received callback for node 69fe7c17ef513bcf3f028094 INFO: 172.21.0.1:44956 - "POST /node/69fe7c17ef513bcf3f028094 HTTP/1.0" 202 Accepted 2026-05-11 00:13:13,274 - lava_callback - INFO - Starting async job submit for node 69fe7c17ef513bcf3f028094 2026-05-11 00:13:13,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:13:13,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7c17ef513bcf3f028094 HTTP/1.1" 200 None 2026-05-11 00:13:13,297 - lava_callback - DEBUG - Processing node 69fe7c17ef513bcf3f028094: baseline-arm64-baylibre 2026-05-11 00:13:13,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fe7c17ef513bcf3f028094 2026-05-11 00:13:13,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:13:13,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7c17ef513bcf3f028094 HTTP/1.1" 200 None 2026-05-11 00:13:13,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:13:13,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-11 00:13:13,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 00:13:13,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe7c17ef513bcf3f028094 HTTP/1.1" 200 None 2026-05-11 00:13:13,369 - lava_callback - ERROR - Error processing callback for node 69fe7c17ef513bcf3f028094: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]